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Abstract 

Interference is a major issue limiting the performance in wireless networks. Cooperation among 
receivers can help mitigate interference by forming distributed MIMO systems. The rate at which 
receivers cooperate, however, is limited in most scenarios. How much interference can one bit of 
receiver cooperation mitigate? In this paper, we study the two-user Gaussian interference channel with 
conferencing decoders to answer this question in a simple setting. We identify two regions regarding the 
gain from receiver cooperation: linear and saturation regions. In the linear region receiver cooperation is 
efficient and provides a degrees-of-freedom gain, which is either one cooperation bit buys one more bit 
or two cooperation bits buy one more bit until saturation. In the saturation region receiver cooperation 
is inefficient and provides a power gain, which is at most a constant regardless of the rate at which 
receivers cooperate. The conclusion is drawn from the characterization of capacity region to within 
two bits. The proposed strategy consists of two parts: (1) the transmission scheme, where superposition 
encoding with a simple power split is employed, and (2) the cooperative protocol, where one receiver 
quantize-bin-and-forwards its received signal, and the other after receiving the side information decode- 
bin-and-forwards its received signal. 

This work was supported by National Science Foundation under grant # CCF-0830796. 
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I. Introduction 

In modern communication systems, interference is one of the fundamental factors that limit 
performance. Characterizing its capacity region is a long-standing open problem, except for 
several special cases (eg., the strong interference regime [HI). The largest achievable region to 
date is reported by Han and Kobayashi [0, and the core of the scheme is a superposition coding 
strategy. Recent progress has been made on both inner bounds and outer bounds: Recently, Etkin, 
Tse, and Wang characterize the capacity region of the Gaussian interference channel to within 
one bit by using a superposition coding scheme with a simple power-split configuration 
and by providing new upper bounds. The constant-gap-to-optimality result [3] provides a strong 
guarantee on the performance of the proposed scheme. Later, Motahari and Khandani [0, Shang, 
Kramer, and Chen 0, and Annapureddy and Veeravalli [J6j independently improve the bound 
and characterize the sum capacity in a very weak interference regime and a mixed interference 
regime. 

In the above interference channel set-up, transmitters or receivers are not allowed to communi- 
cate with one another, and each user has to combat interference on its own. In various scenarios, 
however, nodes are not isolated, and transmitters/receivers can exchange certain amount of 
information. Cooperation among transmitters/receivers can help mitigate interference by forming 
distributed MIMO systems which provides two kinds of gains: degrees-of-freedom gain and power 
gain. The rate at which they cooperate, however, is limited, due to physical constraints. Therefore, 
one of the fundamental questions is, how much interference can limited transmitter/receiver 
cooperation mitigate? How much gain can it provide? 

In this paper, we consider a two-user Gaussian interference channel with conferencing decoders 
to answer this question regarding receiver cooperation. Conferencing among encoders/decoders 
has been studied in 0, ®, g), OH, 0J], and (T2). Our model is similar to those in [11 J and 
lfl2ll but in an interference channel set-up. The work in |[TTll characterizes the capacity region 
of the compund MAC with unidirectional conferencing between decoders. For general set-up, 
it provides achievable rates but is not able to establish a constant-gap-to-optimality result. The 
work in [12J considers one-sided Gaussian interference channels with unidirectional conferencing 
between decoders and characterizes the capacity region in strong interference regimes and the 
asymptotic sum capacity at high SNR. For general receiver cooperation, works including [fT3l and 
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lfT4ll . investigate cooperation in interference channels with a set-up where the cooperative links 
are of the same band as the links in the interference channel. In particular, [fT4l characterizes 
the sum capacity of Gaussian interference channels with in-band receiver cooperation to within 
a constant number of bits. Our work, on the other hand, is focused on the Gaussian interference 
channel with out-of-band (orthogonal) receiver cooperation, and studies its entire capacity region. 

We propose a strategy achieving the capacity region universally to within 2 bits per user, 
regardless of channel parameters. The two-bit gap is the worst-case gap which can be loose 
in some regimes, and it is vanishingly small at high SNR when compared to the capacity. The 
strategy consists of two parts: (1) the transmission scheme, describing how transmitters encode 
their messages, and (2) the cooperative protocol, describing how receivers exchange information 
and decode messages. For transmission, both transmitters use superposition coding [2] with 
the same power-split as in the case without cooperation J3). For the cooperative protocol, it is 
appealing to apply the decode-forward or compress-forward schemes, originally proposed in 17511 
for the relay channel, like most works dealing with more complicated networks, including ifTOl . 
[fTT|. [fT2|. [fT3ll . |[T6l . etc. It turns out neither conventional compress-forward nor decode-forward 
achieves capacity to within a constant number of bits universally for the problem at hand. On 
the other hand, ifTTl . lfT8l . and [fT9l observe that the conventional compress-forward scheme (031 
may be improved by the destination directly decoding the sender's message instead of requiring 
to first decode the quantized signal of the relay. We use such an improved compress-forward 
scheme as part of our cooperative protocol. One of the receivers quantizes its received signal at 
an appropriate distortion, bins the quantization codeword and sends the bin index to the other 
receiver. The other receiver then decodes its own information based on its own received signal 
and the received bin index. After decoding, it bin-and-forwards the decoded common messages 
back to the former receiver and helps it decode. 

We identify two regions regarding the gain from receiver cooperation: linear and saturation 
regions, as illustrated through a numerical example in Fig. [TJ In the linear region, receiver 
cooperation is efficient, in the sense that the growth of user data rate is roughly linear with 
respect to the capacity of receiver-cooperative links. The gain in this region is the degrees- 
of-freedom gain that distributed MIMO systems provide. On the other hand, in the saturation 
region, receiver cooperation is inefficient in the sense that the growth of user data rate becomes 
saturated as one increases the rate in receiver-cooperative links. The gain is the power gain of 
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at most a constant number of bits, independent of the channel strength. We will focus on the 
system performance in the linear region, because not only that in most scenarios the rate at which 
receivers can cooperate is limited, but also that the gain from cooperation is more significant. 
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Fig. 1. The Gain from Limited Receiver Cooperation 

With the constant-gap-to-optimality result, we find that the fundamental gain from cooperation 
in the linear region as follows: either one cooperation bit buys one more bit or two cooperation 
bits buy one more bit until saturation, depending on channel parameters. In the symmetric set-up, 
at high SNR, when INR is below 50% of SNR in dB scale, one-bit cooperation per direction 
buys roughly one-bit gain per user until full receiver cooperation performance is reached, while 
when INR is between 67% and 200% of SNR in dB scale, one-bit cooperation per direction buys 
roughly half-bit gain per user. In the weak interference regime, for a given pair of (SNR, INR), 
when the receiver-cooperative link capacity C B > log INR, cooperation among receivers can 
get a close-to-interference-free (that is, within a constant number of bits) performance. In the 
strong interference regime, in contrast to that without cooperation, system performance can be 
boost beyond interference-free performance, by utilizing receiver-cooperative links not only for 
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interference mitigation but also for forwarding desired information, since the cross link is stronger 
than the direct link. 

The rest of this paper is organized as follows. In Section [TTJ. we introduce the channel model 



and formulate the problem. In Section III we provide intuitive discussions about achievability 
and motivate our two-round strategy. Then we give examples to illustrate why it is not a good 
idea to use cooperative protocols based on conventional compress-forward or decode-forward. In 
Section |IV} we describe the strategy concretely and derive its achievable rates, and in Section [V] 
we show that the achievable rate region is within 2 bits per user to the outer bounds we provide. 
In addition, we characterize the capacity region of compound MAC with conferencing decoders 
to within 1 bit, as a by-product. In Section VII[ focusing on the symmetric set-up, we illustrate 
the fundamental gain from receiver cooperation by deriving the optimal number of generalized 
degrees of freedom (g.d.o.f.) and compare it with the achievable ones of suboptimal schemes. 

II. Problem Formulation 

A. Channel Model 

The two-user Gaussian interference channel with conferencing decoders is depicted in Fig. |2j 



m 2 - 
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Fig. 2. Channel Model 



1 ) Transmitter-Receiver Links: The transmitter-receiver links are modeled as the normalized 
Gaussian interference channel: 



yx = h n xi + h 12 x 2 + z x 
y 2 = h 2X x x + h 22 x 2 + z 2 , 



(1) 

(2) 
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where the additive noise processes {zj[n]}> (i = 1, 2), are independent CAf(0, 1), i.i.d. over time. 
In this paper, we use [.] to denote time indices. Transmitter i intends to convey message m« to 
receiver i by encoding it into a block codeword {xj[n]}^ =1 , with transmit power constraints 



N 

n=l 



< 1, i = 1,2, (3) 



for arbitrary block length AT. Note that outcome of the encoder depends solely on its own 
message. Messages m 1 ,m 2 are independent. Define channel parameters 

SMR, t :=\h tt \ 2 , INR,:=|/g 2 , i,j = 1,2, i ^ j. (4) 

2) Receiver-Cooperative Links: The receiver-cooperative links are noiseless with finite ca- 
pacity Cfj from receiver % to j. Encoding must satisfy causality constraints: for any time index 
n = 1,2, . . . , N, u 21 [n] is only a function of {y 2 [l], • • • ,J/2[« - l],«i2[l], • • -,u 12 [n - 1]}, and 
u 12 [n] is only a function of {yi[l], . . . ,yi[n - l],u 2 i[l], • • • ,u 21 [n - 1]}. 

In the rest of this paper, we use v n to denote the sequence {i>[l], . . . , v[n]}. 

B. Strategies, Rates, and Capacity Region 

We give the basic definitions for the coding strategies, achievable rates of the strategy, and 
the capacity region of the channel. 

Definition 2.1 (Strategy and Average Probability of Error): An (Mi, M 2 , iV)-strategy consists 
of the following: for i,j — 1, 2, % ^ j, 

(1) message set Mi := {1,2,..., Mi} for user i; 

(2) encoding function ef 1 ^ : Mi — > C N , rrii h- > rr^ at transmitter i; 

(3) set of relay functions {rf ] }% =l such that Uij [n\ = rf\y™-\u r ;r l ) e {1, 2, . . . , 2 c l }, 
Vn = 1, 2, . . . , N at receiver i; 

(4) decoding function ciJ 7V) : x {1, 2, . . . , 2^°*} -> (yf , «J) i-> m, at receiver i. 
The average probability of error 



p( 7v) . = 1 y- pr I rf i (j/i >«2i) ^ m i or 

e ' MiM 2 2-^ | „Jvw m 

1 2 mieMi,m 2 eA^ 2 I "2 12/2 5 ^12J 7^ m 2 



mi, m 2 are sent > (5) 



Definition 2.2 (Achievable Rates and Capacity Region): A rate tuple (Ri,R 2 ) is achievable 
if for any e > and for all sufficiently large N, there exists an (Mi ) M 2) N) strategy with 
Mi > 2 NR \ for i = 1,2, such that < e. The capacity region ^ is the collections of all 
achievable (R 1: R 2 ). 
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C. Notations 

We summarize below the notations used in the rest of this paper. 

• For a real number a, (a) + := max(a, 0) denotes its positive part. 

• For sets A, B C IR fc in A;-dimensional space, A © B := {a + b : a G A, b G B} denotes the 
direct sum of A and B. conv{v4} denotes the convex hull of the set A. 

• With a little abuse of notations, for x, y G ¥ q , x © y denotes the modulo-g sum of x and y. 

• Unless specified, all the logarithms log(.) is of base 2. 

III. Motivation of Strategies 
Before introducing our main result, we first provide intuitive discussions about achievability 



and motivate our two-round strategy (to be described in detail in Section IV) from a high-level 
perspective. Then we give examples to illustrate why cooperative protocols based on conventional 
compress-forward or decode-forward may not be good for cooperation between receivers to 
mitigate interference. Throughout the discussion in this section, we will make use of the linear 
deterministic channel proposed in |fT9l . 



A. Optimal Strategy in the Linear Deterministic Channel 

First, consider the following symmetric channel: SNR, = SNR 2 = SNR, INRi = INR 2 = INR, 
and Cg, = Cfi = C B . Set INR to be 2/3 of SNR in dB scale, that is, log INR = § logSNR. Set 
C B = | log SNR. The corresponding linear deterministic channel (LDC) is depicted in Fig. |3j 
The bits at the levels of transmitters/receivers can be thought of as chunks of binary expansions 
of the transmitted/received signals. Note that in this example, one bit in the LDC corresponds 
to | log SNR in the Gaussian channel. 

We begin with the baseline where two receivers are not allowed to cooperate. The transmitted 
signals are naturally broken down into two parts: (1) the common levels, which appear at both 
receivers, and (2) the private levels, which only appear at its own receiver. Each transmitter splits 
its message into common and private parts, which are linearly modulated onto the common and 
private levels of the signal respectively. Each receiver then decodes both user's common messages 
and its own private message by solving the linear equations it received. This is shown to be 
optimal in the two-user interference channel EUll . In this example (Fig. |3j(a)), bits a\ and b\ are 
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common, while a 3 and 6 3 are private. The sum capacity without cooperation is 4 bits. Since all 
levels at both receivers are occupied, one cannot turn on bits a 2 or b 2 without causing collisions. 
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(c) Conventional Compress-Forward 



Fig. 3. An Example Channel 



With receiver cooperation, the natural split of transmitted signals does not change. This 
suggests that the encoding procedure and the aim of each decoder remain the same. Each 
receiver with the help from the other receiver, however, is able to decode more information. 
Since each user's private message is not of interest to the other receiver, a natural scheme for 
receiver cooperation is to exchange linear combinations formed by the signals above the private 
signal level so that the undesired signal does not pollute the cooperative information. In this 
example, as illustrated in Fig. [3}(b), with one-bit cooperation in each direction in the LDC, the 
optimal sum rate is 5 bits, achieved by turning on one more bit a 2 . This causes collisions at 
the second level at receiver 1 and at the third level at receiver 2, while they can be resolved 
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with cooperation: receiver 1 sends 61 © a 2 to receiver 2, and receiver 2 sends b\ to receiver 1. 
Now receiver 1 can solve (01,02,03,61), and receiver 2 can solve (61,63,01,02). In fact, the 
exchanged linear combinations are not unique. For example, receiver 1 can send (61 © a 2 ) © ai 
and receiver 2 can send 61 © a\, and this again achieves the same rates. As long as receiver 1 
does not send a linear combination containing the private bit a 3 and the sent linear combination 
is linearly independent of the signals at receiver 2 (and vice versa for the linear combination 
sent from receiver 2 to receiver 1), the scheme is optimal for this example channel. The above 
discussion regarding the scheme in the LDC naturally leads to an implementable one-round 
scheme in the Gaussian channel, where both receivers quantize-and-bin their received signals at 
their own private signal level. 

In the above example, it is optimal that each receiver sends to the other linear combinations 
formed by its received signal above its private signal level. Is this optimal in general? The answer 
is no. Consider the following asymmetric example: SNR 2 = INR 2 , SNR1 is 2/3 of SNR 2 in dB, 
and INRi is 1/3 of SNR 2 in dB. Cf 2 = |logSNR 2 and = |logSNR 2 . The corresponding 
LDC is depicted in Fig. |4j where one bit in the LDC corresponds to | log SNR 2 in the Gaussian 
channel. First consider the same scheme as that in the previous exmaple. Note that if receiver 
2 just forwards signals above its private signal level, it can only forward a\ to receiver 1 and 
achieves R\ up to 2 bits. On the other hand, if receiver 2 forwards a 3 to receiver 1, which is 
below user 2's private signal level, it achieves _Ri = 3 bits. From this example, we see that 
once there are "useful" information (which should not be polluted by the receiver's own private 
bits) lies at or below the private signal level (in this example, the bit a 3 ), the one-round scheme 
described in the previous example is suboptimal. To extract the useful information at or below 
the private signal level, one of the receivers (in this example, receiver 2) can first decode and 
then form linear combinations using (decoded) common messages only. 

Without loss of generality, however, the above situation that there is useful information for the 
other receiver lies at or below the private signal level, only happens at one of the two receivers. 
In other words, there exists a receiver where no useful information (for the other receiver) lies 
at or below the private signal level. The reason is the following: 

1) It is straightforward to see that the capacity region is convex, and hence if a scheme can 
achieve max( fllifl2 ) e<( f {^\R\ + /J-2-R2} for all /xi,/i 2 > 0, it is optimal. 

2) If jUi > /i 2 , we weigh user l's rate more. Since the private bits are cheaper to support in 
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the sense that they do not cause interference at receiver 2, user 1 should be transmitting at 
its full private rate, which is equal to the number of levels at or below the private signal 
level at receiver 1. Therefore, all levels at or below the private signal level are occupied 
by user l's private bits and there is no useful information at receiver 1 for receiver 2. 
3) Similarly if ix\ < Hi, there is no useful information at receiver 2 for receiver 1 at or below 
the private signal level. 

Hence, the following two-round strategy is optimal in the LDC: if /ii > /i 2 , receiver 1 forms a 
certain number (no more than the cooperative link capacity) of linear combinations composed of 
the signals above its private signal level and sends them to receiver 2. After receiver 2 decodes, 
it forms a certain number of linear combinations composed of the decoded common bits and 
sends them to receiver 1. If /i X < /i 2 , the roles of receiver 1 and 2 are exchanged. Note that 
depending on the operating point in the capacity region, we use different configurations, implying 
that time-sharing is needed to achieve the full capacity region. 

From the above discussion, a natural and implementable two-round strategy for Gaussian 
channels emerges. For the transmission, we use a superposition Gaussian random coding scheme 
with a simple power-split configuration, as described in For the cooperative protocol, one 
of the receivers quantize- and-bins its received signal at its private signal level and forwards the 
bin index; after the other receiver decodes with the helping side information, it bin-and-forwards 
the decoded common messages back to the first receiver and helps it decode. In Section [V] we 
shall prove that this strategy achieves the capacity region universally to within 2 bits per user. 
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B. Conventional Compress-Forward and Decode-Forward 

Now, suppose the conventional compress-forward assuming joint Gaussianity of the received 
signals is used for receivers to cooperate. It is a standard approach to evaluate achievable rates 
of Gaussian channels using compress-forward in the literature, including ifTOl . ifTTIl . Ifl2ll . |[T3l . 
lfT6ll . etc. From its corresponding LDC, however, one can see that the two received signals of 
the Gaussian channel, (y 1 ,y 2 ), are not jointly Gaussian. The reason is that, suppose they are 
jointly Gaussian, the conditional distribution of y 2 given y\ should be marginally Gaussian. As 
Fig. [3] suggests, however, conditioning on receiver l's signal results in a hole at the second level 
of receiver 2's signal, which was occupied by a\. Therefore, transmitter 2's common codebook 
is not dense enough to make the conditional distribution of y 2 given y x marginally Gaussian. 
The incorrect assumption results in larger quantization distortions, as depicted in Fig. |3j(c). 
The information sent from receiver 1 to receiver 2, a\, is redundant, and cannot help mitigate 
interference a 2 . Hence, the achievable sum rate is 4 bits (3 bits for user 1 and 1 bit for user 
2), which is the same as that without cooperation and is one bit smaller than the optimal one. 
Recall that 1 bit in the LDC corresponds to |logSNR in the Gaussian channel, therefore the 
performance loss is unbounded as SNR — > oo. The main reason why conventional compress- 
forward does not work well is that the scheme does not well utilize the dependency between 
the two received signals. 

On the other hand, suppose two receivers cooperate based on the decode-forward scheme. 
Note that there is no gain if we require both common messages to be decoded at one of the 
receivers at the first stage without cooperation. By symmetry we can assume that, without loss 
of generality, each receiver first decodes its own common message and then bin-and-forwards 
the decoded information to the other receiver. At the second stage, it then decodes the other 
user's common message with the help from cooperation and decodes its own private message. 
In the corresponding LDC, the common bit a 2 cannot be decoded at the first stage, and hence 
the total throughput using this strategy is at most 4 bits, which is again the same as that without 
cooperation. The reason why decode-forward is not good for the two receivers to cooperate is 
that, it is too costly to decode users' own common message at the first stage without the help 
from cooperation. 
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IV. A Two-Round Strategy 

In this section we describe the two-round strategy and derive its achievable rate region. The 
strategy consists of two parts: (1) the transmission scheme and (2) the cooperative protocol. 

A. Transmission Scheme 

We use a simple superposition coding scheme with Gaussian random codebooks. For each 
transmitter, it splits its own message into common and private (sub-)messages. Each common 
message is aimed at both receivers, while each private one is aimed at its own receiver. Each 
message is encoded into a Gaussian random codeword with certain power. For transmitter i, 
the power for its private and common codewords are Q ip and Q ic = 1 — Q ip respectively, for 
i = 1,2. As [3] points out, since the private signal is undesired at the unintended receiver, a 
reasonable configuration is to make the private interference at or below the noise level so that it 
does not cause much damage and can still convey additional information in the direct link if it is 
stronger than the cross link. When the interference is stronger than the desired signal, simply set 
the whole message to be common. In a word, for = (1, 2) or (2, 1), Q ip = max |]j^r, 1 j 
if SNRj > INRj, and Q ip = otherwise. 

B. Cooperative Protocol 

The cooperative protocol is two-round. We briefly describe it as follows: for = (1,2) or 
(2, 1), at the first round, receiver j quantizes its received signal and sends out the bin index 
(described in detail below). At the second round, receiver % receives this side information, 
decodes its desired messages (both users' common message and its own private message) 
with the decoder described in detail below, randomly bins the decoded common messages, and 
sends the bin indices to receiver j. Finally receiver j decodes with the help from the receiver- 
cooperative link. We call this a two-round strategy STGj^j^j, meaning that the processing 
order is: receiver j quantize-and-bins, receiver i decode-and-bins, and receiver j decodes. Its 
achievable rate region is denoted by By time-sharing, we can obtain achievable rate 

region M := conv {^ 2 -+i-+2 U ^i^2^i}> convex hull of the union of two rate regions. 

Remark 4.1 {Engineering interpretation): There is a simple way to understand the strategy 
from an engineering perspective. To achieve max( Rl # 2 ) &3 g {[XiRi + H2R2} for some non-negative 
(/ii,/i 2 ), the processing configuration can be easily determined: strategy STGj^j^-, should be 
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used, where i = argmin /=1 2 {/•**} an d j = argmax i=1 2 {l JL i}- I n a word, the receiver which 
decodes last is the one we favor most. This is the high-level intuition we obtained from the 
discussion in the LDC in Section Hill 

In the following, we describe each component in detail, including quantize -binning, decode- 
binning, and their corresponding decoders. For simplicity, we consider strategy STG2->i^2- 

Quantize-binning: 

Upon receiving its signal from the transmitter-receiver link, receiver 2 does not decode mes- 
sages immediately. Instead, serving as a relay, it first quantizes its signal by a pre-generated 
Gaussian quantization codebook with certain distortion, and then sends out a bin index deter- 
mined by a pre-generated binning function. How should we set the distortion? As discussed in 
the previous section, note that both its own private signal and the noise it encounters are not of 
interest to receiver 1 . Therefore, a natural configuration is to set the distortion level equal to the 
maximum of noise power and private signal power level. 

Decoder at receiver 1 : 

After retrieving the receiver-cooperative side information, that is, the bin index, receiver 1 
decodes two common messages and its own private message, by searching in transmitters' 
codebooks for a codeword triple (indexed by the two common messages and the user's own 
private message) that is jointly typical with its received signal and some quantization point 
(codeword) in the given bin. If there is no such unique codeword triple, it declares an error. 

Decode-binning: 

After receiver 1 decodes, it uses two pre-generated binning functions to bin the two common 
messages and sends out these two bin indices to receiver 2. 

Decoder at receiver 2: 

After receiving these two bin indices, receiver 2 decodes two common messages and its own 
private message, by searching in transmitters' codebooks for a codeword triple that is jointly 
typical with its received signal and the common messages both lie in the given bins. 

Remark 4.2 (Difference from the conventional compress-forward): The action of receiver 2 as 
a relay is very similar to that of the relay in the conventional compress-forward with Gaussian 
vector quantization. Note that the main difference from the conventional compress-forward with 
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Gaussian vector quantization lies in the decoding procedure (at receiver 1) and the chosen 
distortion. In the conventional Gaussian compress-forward, the decoder first searches in the 
bin for one quantization codeword that is jointly typical with its received signal from its own 
transmitter only, assuming that the two received signals are jointly Gaussian. This may not 
be true since a single user may not transmit at the capacity in its own link, which results in 
"holes" in signal space. As a consequence, this scheme may not utilize the dependency of two 
received signals well and cause larger distortions. Our scheme, on the other hand, utilizes the 
dependency in a better way by jointly deciding the quantization codeword and the message triple, 
consequently allows smaller distortions, and is able to reveal the beneficial side information to 
the other receiver. 

Quantize-binning and its corresponding decoding part of our scheme is very similar to extended 
hash-and-forward proposed in |[T8l . in which it is pointed out that the scheme has no advantage 
over conventional compress-forward in a single-source single-relay setting. Due to the above 
mentioned issues, however, we recognize in our problem where the channel consists of two 
source-destination pairs and two relays, the scheme has an unbounded advantage over the 
conventional compress-forward in certain regimes. This will be made clear in later sections. 

C. Achievable Rates 

The following theorem establish the achievable rates of strategy STG 2 ^i^2- Let R ic and R ip 
denote the rates for user z's common message and private message respectively, for i = 1,2. 

Theorem 4.3 (Achievable Rate Region for STG 2 _ > i^2j-' The rate tuple (R\ c , -R20 -Rip, R2 P ) sat- 
isfying the following constraints are achievable: 
Constraints at receiver 1 : 

Ri p < min{/(xi;?/i|xi c ,X2 C ) + (C^ - I (xr, y 1} y 2 \x lc , x 2c )} (6) 

R 2c < min{/(x 2c ;t/i|xi) + (C^ - £ x ) + , I (x 2c ; Vi, Stel^i)} (7) 

R 2c + Rip < mm{j(x2 C ,xi;?/i|xi c ) + (C^ - £i) + , / (x 2c , x x ; y u y 2 \x lc )} (8) 

R lc + R lp < min{J(a;i;2/i|a;ac) + (C21 - 1 (»i; Vi, jfckac)} (9) 

Ric + R2c + Rip < min{J(xi,x 2c ;?/i) + (Cf x - £i) + , I (x lt x 2c ; y u y 2 )} (10) 

where £1 = I (y 2 ; y 2 \x\ c , x\, x 2c , y\). For % = 1,2, x ic ~ CJ\f(0,Q ic ) is the common codebook 
generating random variable. x\ = x\ p + x\ c is the superposition codebook generating variable, 
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where x\ v ~ CM (0,Qi p ) is independent of X\ c . y 2 — y 2 + z 2 is the quantization codebook 
generating random variable, and % ~ CM (0, A 2 ), independent of everything else. A 2 is the 
quantization distortion at receiver 2. 
Constraints at receiver 2 : 

R 2p < I (x 2 ;y 2 \x 2c: x lc ) (11) 

Ric + R2 P < I { x ic,x 2 ;y 2 \x 2c ) + Cf 2 (12) 

R2c + R2p < I (x 2 ;y 2 \x lc ) + C^ 2 (13) 

R2c + Ric + R2 P < I (x 2 , x lc ; y 2 ) + Ci 2 , (14) 

where x 2 = x 2p + x 2c is the superposition codebook generating variable, and x 2p ~ CM (0, Q 2p ) 
is independent of x 2c - 

Proof: For details, see Appendix |Aj Here we give some high-level comments on these rate 
constraints. First, unlike interference channels without cooperation, here receiver 1 is required 
to decode m 2c correctly so that it can help receiver 2. This additional requirement gives the rate 
constraint Q on R 2c . 

Second, in the set of constraints at receiver 1, on the right-hand side they are all minimum 
of two terms. The second term corresponds to the case when the receiver-cooperative link is 
strong enough to convey the quantized y^ correctly. The first term corresponds to the case when 



receiver 1 can only figure out a set of candidates of quantized y^. In Section III we see that, 
in the LDC as long as the quantization level is chosen such that no private signals pollute the 
cooperative information, the cooperation from receiver 2 to 1 is able to gain comparing 
with the case without cooperation. In the Gaussian channel, however, due to the carry-over of 
real additions and the Gaussian vector quantization, there is a rate loss of £1 bits (which is 
at most a constant number of bits if we choose the quantization distortion properly). In fact, 
£1 = / (y 2 ; y 2 \xi c , x 1 ,x 2c , yi) corresponds to the number of private bits polluting the cooperative 
linear combinations in the LDC if one does not choose the quantization distortion properly. 

Finally, in the set of constraints at receiver 2, since receiver 1 only help receiver 2 decoding 
m lc and m 2c , there is no enhancement in R 2p . ■ 
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(19) 



We shall use the following shorthand notations throughout the rest of the paper: for = 

(1,2), (2,1), 

SNR ip := \h^Q ip = SNRj ■ Q ip , (15) 

\NR ip := |/^| 2 Q, P = \URi-Q jp . (16) 

Next, we quantify the "rate loss" term £i in the set of rate constraints at receiver 1, in terms 
of distortions A 2 : 

£i = yi\x\c, X2c,yi) = h(y 2 \xi c ,x 1 ,x 2 c,yi) - h(y 2 \x lc ,x 1 ,X2 C ,yi,y 2 ) (17) 
= h (h 2 2X 2 p + z 2 + z 2 \h 12 x 2p + z 1 )—h (z 2 ) (18) 

lQ g(^ + (i4?N R R 1 2 ; ) A 2 )' SNR 2 >INR 
log(^), SNR 2 <INR 

< log ^ j , (20) 

Below we shall see why the intuition of quantizing at the private signal level works. By 
choosing A 2 = max{SNR 2p , 1}, the "rate loss" £i is upper bounded by a constant. In particular, 
when SNR 2 > INRi, 6 < log 3; when SNR 2 < INRi, & = 1. On the other hand, note that for 
receiver 1 the unwanted signal power level in y 2 is roughly max{SNR 2p , 1}, and hence replacing 
y 2 by y 2 gains at most a constant number of bits. 

Remark 4.4: The above configuration of the distortion may not be optimal. The achievable 
rates can be further improved if we optimize over all possible distortions. For example, if the 
cooperative link capacity is huge, one could lower the distortion level to yield a finer description 
of received signals. With the above simple configuration, however, we are able to show that it 
achieves the capacity region to within a constant number of bits universally. 

V. Characterization of the Capacity Region to within 2 Bits 

The main result in this section is the characterization of the capacity region to within 2 
bits per user universally, regardless of channel parameters. To prove it, first we provide outer 
bounds of the capacity region. Ideas about how to prove them are outlined, and details are left 



in appendices. Then we make use of Theorem 4.3 to evaluate the achievable rate region, and 



show that it is within 2 bits per user to the proposed outer bounds. 
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A. Outer Bounds 

To prove the outer bounds, the main idea is the following: first, upper bound the rates by mutual 
informations via Fano's inequality and data processing inequality; second, decompose them 
into two parts: (1) terms which are similar to those in Gaussian interference channels without 
cooperation, and (2) terms which correspond to the enhancement from cooperation. We use the 
genie-aided techniques in (31 to upper bound the first part and obtain namely the Z-channel 
bound (where the genie gives interfering symbols x 1 ^ to receiver i, i ^ j) and ETW-bound 
(where the genie gives the interference term caused by user i at receiver j, := hjixf + zf 
to receiver i). For the second part, we make use of the fact that u^ 2 and are both functions 
of (yi iDi), an d other straightforward bounding techniques. The results are summarized in the 
following lemma. 
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Lemma 5.1: C ff, where ^ consists of nonnegative rate tuples (Ri,R 2 ) satisfying 
Rx < log(l + SNRi) +min jcl^log ( 1 1 INR2 



R2 < log(l + SNR 2 ) + min <^ Cf 2 , log 1 + 



1 + SNRi 

INRi 
I + SNR2 



Ri + R2 < log (1 + SNR 2 + INR 2 ) + log ( 1 + 1 |N X R ) + C 12 



SNRx 



B 



Ri + R 2 < log (1 + SNRx + INR X ) + log ( 1 + 1 ) + C B 



21 



1 + INRx J V 1 + INR 2 
+ log (1 + SNRi + INRx) + + C? 2 

i? 1 + 2i? 2 <logfl + INR 1 + -^i-Vlogfl ' ^ 



1 + INR 2 / V 1 + INR i 

+ log (1 + SNR 2 + INR 2 ) + C B 2 + C B 

/ SNR 2 INRx \h n h 2 2 - h 12 h 2 i\ 

2R 1 + R 2 <log[l + - n^ + INR 2 + SNR! ' 1 



1 + INRi 1 + INRi 1 + INRi 

+ log (1 + SNRi + INRi) + C 21 

i?i + 2i? 2 < log 1 + -i- + INRi + SNR 2 + + 1 - 



(21) 



fl 1 + i^<tog(l + INR 1 + 1 ^ 1 Ra ^ +log(l + INR 2 + I ^|-) +C 2 B i + Cf 2 (22) 



(23) 



R Y + R 2 < log (1 + SNRi + SNR 2 + INRi + INR 2 + \h u h 22 - h 12 h 21 \ 2 ) (24) 
2^i + J R 2 <logfl + INR 2 + -^-Vlogfl 1 SNRl 



(25) 



(26) 



1 + INR 2 x ' 1 + INR 2 1 + INR 2 

+ log(l + SNR 2 + INR 2 ) + C B 2 
Proof: Details are left in Appendix [B} Below we give a short outline and intuitions. First of 



all, bounds ( |2Tj ) and ( [24] ) are straightforward cut-set upper bounds of individual rates and sum 
rate respectively. 

Bound ( [22] ) corresponds to the ETW-bound in Gaussian interference channels without co- 
operation. In the genie-aided channel, we upper bound the gain from receiver cooperation by 
Cf 2 + C 21 , that is, in both directions each bit is useful. 

Bounds ( [23] ) correspond to the Z-channel bounds. In the genie-aided channel, since the genie 
gives interfering symbols x 1 ^ to receiver i, i 7^ j, there is no interference at receiver i. Intuitively, 
the cooperation from receiver j to i is now providing only the power gain, and the genie can 
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provide yf to receiver i to upper bound this power gain. The gain from the cooperation from 
receiver i to j is upper bounded by Cf . 



Bounds (25) on Ri + 2Rj are derived by giving side information sf to receiver i and side 



information xf and yf to one of the receiver j's. In the genie-aided channel there is an underlying 
Z-channel structure, and hence the gain from one direction of the cooperation is absorbed into 
a power gain. The rest is upper bounded by Cf 2 + C| x . 



Bounds (26) on Ri + 2Rj are derived by giving side information yf and sf := hjixf + zf, 
where Zj ~ CJ\f(0, 1) and independent of everything else, to receiver i and side information 
yf to one of the receiver j's. In the genie-aided channel, there is an underlying point-to-point 
MIMO channel, and hence the gain from both directions of cooperation is absorbed into the 
MIMO system. The rest is upper bounded by C?-. 

Note that the derivation of all bounds are irrelevant to the relations among INR's and SNR's. 



We make the following observations: 



Remark 5.2 (Dependence on phases): The sum-rate cut-set bound (24) not only depends on 
SNR's and INR's but also on the phases of channel coefficients, due to the term \huh22 — ^12^-21 1 2 - 
In particular, when the receiver-cooperative link capacities C B 's are large, the two receivers 
become near-fully cooperated, and the system performance is constrained by that of the SIMO 
MAC, that is, it enters the saturation region. Therefore this bound becomes active and the outer 
bound depends on phases. 

Remark 5.3 (Strong interference regime): When SNRi < INR 2 and SNR 2 < INRi, unlike the 
Gaussian interference channel of which the capacity region is equal to that of a compound 
MAC in the strong interference regime [1], here we cannot apply Sato's argument. Recall that 
when there is no cooperation, once user i's own message is decoded successfully at receiver 
i, it can produce yf which has the same distribution as yf. Since the error probability for 
decoding user j's message at receiver j only depends on the marginal distribution of yf, it 
can be concluded that at receiver i one can achieve the same performance for decoding user 
j's message by using the same decoder as that in receiver j, and hence receiver i can decode 
user j's message successfully as well. When there is cooperation, however, the error probability 
for decoding user j's message at receiver j depends on the joint distribution of (yf,uf). Note 
that the additive noise terms in yf and yf have different correlations with the noise term zf, 
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and ufj can be highly correlated with zf. As a consequence, the joint distributions of (y^,u^) 
and (y^ufj) are not guaranteed to be the same, and receiver i may not be able to achieve the 
same performance for decoding user j's message by using the same decoder as that in receiver 
j. Therefore, we cannot claim that the capacity region under strong interference condition is 
the same as that of compound MAC with conferencing decoders (CMAC-CD). Instead, we take 
the Z-channel bound ( |23| ), which is within 1 bit to the sum rate cut-set bound of CMAC-CD in 
strong interference regimes. This will be discussed in the last part of this section. 



B. Capacity Region to within 2 bits 

Subsequently we investigate three qualitatively different cases, namely, weak interference, 
mixed interference, and strong interference^ in the rest of this section. We summarize the main 
achievability result in the following theorem: (recall that ^ is the outer bound region defined in 
Lemma \5.l) 

Theorem 5.4 (Within constant gap to capacity region): 



C <*f C <g C M® ([0,2] x [0,2]). 



(27) 



Proof: Proved by Lemma 5.5, 5.8, and 5.11 in the rest of this section. 



C. Weak interference 

In the case SNRi > INR 2 and SNR 2 > INRi, the superposition coding configuration is to split 
message rri{ into m ic and m ip , for both users i — 1, 2. We first consider STG 2 ^i^ 2 : referring to 



Theorem 4.3 we obtain the set of achievable rates (Ri C} R,2c, Rip, R2 P )- The term £i < log 3 



1.59 bits, due to ([20]) in Section IV-C and the chosen distortion A 2 = max{SNR 2p , 1}. 

To simplify calculations, note that the right-hand-side of ([6]) is at most a constant number of 
bits greater that its lower bound / (x\\ yi\x\ C) x 2c ), the right-hand-side of ^ is at most a constant 
number of bits greater that its lower bound I (a^c! Vi\xi), and the right-hand-side of (|9]) is at 

1 We distinguish the general set-up into three qualitatively different cases: (1) weak interference, where SNRi > INR2 and 
SNR 2 > INRi; (2) mixed interference, where SNRi > INR 2 and SNR 2 < INRi; (3) strong interference, where SNRi < INR 2 
and SNR 2 < INRi. 
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most a constant number of bits greater that its lower bound I (x\\ yi\x 2c ). Therefore, we replace 
these three constraints by 

Rip < I (x 1 ;y 1 \x lc ,x 2c ) (28) 

R2c<I(x 2c ;y 1 \x 1 ) (29) 

Ric + Ri P <I(xi;yi\x 2c ) (30) 

in the following calculations. Next, rewriting R ip = Ri — R ic for i = 1,2, applying Fourier- 
Motzkin algorithm to eliminate Ri c and R 2c , and removing redundant terms (details omitted 
here), we obtain an achievable 3? 2 ^i^ 2 , which consists of nonnegative (Ri, R 2 ) satisfying: 

Ri < mm {I (xxiy^c) , I (x^yilxic, x 2c ) + I (x lc , x 2 ; y 2 \x 2c ) + C± 2 } (31) 

R 2 < mm {I (x 2 ;y 2 \x lc ) + Cf 2 , / (x 2c ; + I (x 2 ;y 2 \x lc , x 2c ) } (32) 

Ri + R 2 < I {xi,x 2c ;yi) + I (x 2 ;y 2 \x lc ,x 2c ) + (C 21 -£i) + (33) 

Ri + R 2 < I (xi, x 2c ; yi, y 2 ) + 1 (x 2 ; y 2 \x lc , x 2c ) (34) 

R\ + R 2 < I (xi,x 2c ;yi\x lc ) + I (xi c ,x 2 ;y 2 \x 2c ) + Cf 2 + (C 21 - £i) + (35) 

Ri + R 2 < I (xi, x 2c ; yi, y 2 \x lc ) + / (x lc , x 2 ; y 2 \x 2c ) + Cf 2 (36) 

Ri + R 2 < I {xx;yi\xi c ,x 2c ) + I (x lc , x 2 ; y 2 ) + Cf 2 (37) 

Ri + R 2 < I {xi,yx\x lc , x 2c ) + I{x 2c ;yi\x 1 ) + I(x lc ,x 2 ; y 2 \x 2c ) + Cf 2 (38) 

2i?i + R 2 < I (xi,x 2c ;yi) + I (xr, yi\xi c , x 2c ) + I (x lc , x 2 ; y 2 \x 2c ) + Cf 2 + (C 21 - £i) + (39) 

2R 1 + R 2 < I (xi,x 2c ; yi,y 2 ) + 1 {xr,yi\xi c , x 2c ) + I (x lc ,x 2 ; y 2 \x 2c ) + Cf 2 (40) 

Ri + 2i? 2 < I {xi,x 2c ;yi\xi c ) + / (ar lc , x 2 ; y 2 ) + I (x 2 ;y 2 \x lc ,x 2c ) + Cf 2 + (C 21 - £i) + (41) 

Rx + 2R 2 < I (x-i_,x 2c ]yi\xi c ) + 1 (x 2c ; yi\xi) + I (x lc ,x 2 ;y 2 \x 2c ) + I (x 2 ; y 2 \x lc , x 2c ) (42) 

+ C* +((&-&) + (43) 

Ri + 2i? 2 < I {x 1 ,x 2c ;y 1 ,y 2 \x lc ) + I (x ic , x 2 ; y 2 ) + 1 (x 2 ; y 2 \x lc , x 2c ) + Cf 2 (44) 

Ri + 2R 2 < I {x^x^y^y^xic) + I (x 2c ; yi\xx) + I (x lc , x 2 ; y 2 \x 2c ) (45) 

+ I (x 2 ;y 2 \x lc ,x 2c ) + Ci 2 (46) 



We will show that except (40), all bounds are within a constant number of bits to the 
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corresponding outer bounds in Lemma 5.1| By symmetry, however, one can write down £%\^, 2 ^,\ 
and see that it can be compensated by time-sharing with rate points in M\-> 2 -^\. Therefore the 
resulting Si := conv {^ 2 ^i-*2 U ^i^ 2 ^i} is within a constant number of bits to the outer 
bounds in Lemma 5.1| An illustration is provided in Fig. |5J 




We give the following lemma. 

Lemma 5.5 (Rate region in the weak interference regime): 



C^© ([0,2] x [0,2]), (47) 



in the weak interference regime. 

Proof: We need the following claims: 



Claim 5.6: In «3?2-»i-»2> whenever the 2R\ + R 2 bound ( |40| ) is active, 

(a) if R\ + 2R 2 bounds are active, the corner point where R\ + R 2 bound and Ri + 2R 2 bound 
intersect can be achieved; 

(b) if i?i + 2R 2 bounds are not active, the corner point where Ri + R 2 bound and R 2 bound 
intersect can be achieved. 

Above two situations are illustrated in Fig. [6} 

Proof: See Appendix |Cj ■ 



Therefore, the 2Ri + R 2 bound (40) and, by symmetry, its corresponding Ri + 2R 2 bound in 



^i^2^i do not show up in & = conv{^ 2 ^i^ 2 U ^i^ 2 ^i}, and M is within 2 bits per user 
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to the outer bounds in Lemma 5.1 To show this, we first look at the bounds in ^ 2 -»i->2 except 



(40). We claim that 



Claim 5.7: The bounds in ^ 2 ^i^2 except ( |40[ ) satisfies: 

• R\ bound is within 2 bits to outer bounds; 

• R 2 bound is within 2 bits to outer bounds; 

• R\ + i?2 bound is within log 12 bits to outer bounds; 

• 2Ri + R 2 bound is within log 24 bits to outer bounds; 

• Ri + 2R 2 bound is within log 48 bits to outer bounds. 

Proof: See Appendix |Cj ■ 
By symmetry, we obtain similar results for ^i_> 2 ->i, an d hence conclude that the bounds in 
M satisfies: 

• R\ bound is within 2 bits to outer bounds; 

• R 2 bound is within 2 bits to outer bounds; 

• R\ + R 2 bound is within log 12 bits to outer bounds; 

• 2Ri + R 2 bound is within log 48 bits to outer bounds; 

• R\ + 2i? 2 bound is within log 48 bits to outer bounds. 

This completes the proof. ■ 
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D. Mixed interference 

In the case SNRi > INR 2 and SNR 2 < INRi, the superposition coding configuration is to split 
message m 1 into m lc and m lp , while making the whole m 2 to be common. We first consider 



STG 2 ^i^ 2 : by Theorem 4.3, rates satisfying the following are achievable: 

R lp < min{l (x 1 ;yi\x lc ,x 2 ) + (C^ - ^) + , I (x 1 ;yi,y 2 \x lc ,x 2 )} (48) 

R 2 < min{/(x 2 ;?/i|a;i) + (C 21 - £i) + , / (x 2 ; yi, falxi)} (49) 

R 2 + Rip < min{/(x 2 ,a;i;?/i|xi c ) + (C 21 — £i) + , I (x 2 , x\\ y±, y 2 \xic)} (50) 

Ric + Rip < min{/(xi;?/i|a; 2 ) + (C^ - (a?i; y x , y 2 \x 2 )} (51) 

R lc + R 2 + R lp < mm{l (xi,x 2 ;yi) + (C 21 - ^) + , I (x 1 ,x 2 ;y 1 ,y 2 )} (52) 

Ric < I(xi c ;y 2 \x 2 ) + Cf 2 (53) 

R2 < I(x 2 ;y 2 \x lc ) + Cf 2 (54) 

R2 + Ric < I (x 2 ,x lc ;y 2 ) + Cf 2 , (55) 
where £1 = 1 since SNR 2 < INRi. 



Again to simplify calculations, note that the right-hand- side of (48) is at most a constant 



number of bits greater that its lower bound I (xi; y\\xi c , x 2 ), the right-hand- side of ( |49| ) is at 



most a constant number of bits greater that its lower bound I (x 2 ; y\\x\), and the right-hand-side 



of ( pT| ) is at most a constant number of bits greater that its lower bound / (xi]yi\x 2 ). Therefore, 
we replace these three constraints by 

Rip < I (xi, yi\x lc , x 2 ) (56) 
R2<I(x 2 -y 1 \x l ) (57) 
Ric + R\ P < I {xi\yi\x 2 ) (58) 

in the following calculations. Next, rewriting Ri p = Ri — Ri c , applying Fourier-Motzkin al- 
gorithm to eliminate Ri c , and removing redundant terms (details omitted here), we obtain an 
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achievable ^2^i^2> consists of nonnegative (Ri, R 2 ) satisfying: 

Ri < min {I [x X ] yx\x 2 ) ,I(xi] yi\x lc ,x 2 ) + I (x lc ;y 2 \x 2 ) + Cf 2 } (59) 

R 2 < min {/ (x 2 ; yi\xi) , I (x 2 ; y 2 \x lc ) + C B 2 } (60) 

Ri + R2 < I (x u x 2 ; yi) + (C* - &) + (61) 

Ri + R 2 < I (xi,x 2 ;yi,y2) (62) 

Ri + R 2 < I (xi;yi\xi c ,x 2 ) + 1 (x lc ,x 2 ;y 2 ) + C B 2 (63) 

R1 + R2 < I(xi,x 2 ; yi \x lc ) + 1 (x lc ;y 2 \x 2 ) + C B 2 + (C B -£ x ) + (64) 

Ri + R 2 < I (xi, x 2 ; y 2 \ x ic) + ^ (^i c ; 2/2^2) + C B 2 (65) 

i?i + 2R 2 <I(xi, x 2 ; yi\x lc ) + I (xi c , x 2 ; y 2 ) + C B 2 + (C 21 - £1) + (66) 

Ri + 2R 2 < I (a?i, x 2 ; y 2 \x lc ) + I (x lc , x 2 ; y 2 ) + C B 2 (67) 

Comparing ^2-^1^2 with the outer bounds in Lemma |5.1[ one can easily conclude that 
Lemma 5.8 (Mixed interference rate region): 

M 2 ^ 2 C <€ C # C ^1^2 © ([0, 1.5] x [0, 1.5]) , (68) 



in the mixed interference regime. Besides, ^2->i-»2 ^ 
Proof: 

We investigate the bounds in ^ 2 -*i-*2 an d claim that 
Claim 5.9: The bounds in ^ 2 ^i^2 satisfies: 

• R\ bound is within 1 bit to outer bounds; 

• R 2 bound is within 1 bit to outer bounds; 

• R\ + R 2 bound is within 3 bits to outer bounds; 

• R\ + 2R 2 bound is within 3 bits to outer bounds. 

Proof: See Appendix [C] ■ 
This completes the proof. ■ 

E. Strong interference 

In the case SNF^ < IN R 2 and SNR 2 < INRi, it turns out that a one-round strategy STGo ne Round 
described below suffices to achieve capacity to within a constant number of bits. The transmission 
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scheme is the same as that described in Section |IV-A[ The difference is that, both receivers 
quantize-and-bins their received signals and decode with the help from the side information, as 
described in Section IIV-B1 It is called one-round since both receivers decode after one-round 
exchange of informaion. Below is the coding theorem for this strategy: 

Theorem 5.10: The rate tuple (Ri c , R 2c , -Rip, R-2 P ) satisfying the following constraints are 
achievable for STG 0n eRound: 
Constraints at receiver 1 : 

R lp < min{l (x 1 ;y 1 \x lc ,x 2c ) + (C 21 — £i) + , I (xi] yi, fa\xi c , x 2c )} (69) 

R 2c + Rip < min{l (x 2c ,xi;yi\x lc ) + (Cf x - (x 2c , x x ; yi, fa\xi c )} (70) 

R lc + R lp < vai\i{l (xi;yi\x 2c ) + (C 21 - £i) + > I Vi, fa\x 2c )} ( 71 ) 

Ric + R2c + Rip < min{/(x 1 ,x 2c ;yi) + (C 21 - £l) + , I (xi, x 2c ; yi, fa)} (72) 
Constraints at receiver 2 : the above constraints with index "1" and "2" exchanged. 



Proof: Follows the same line as the proof of Theorem 4.3 There is no rate constraint for 
Rj C at receiver i for = (1,2) or (2, 1), since decoding m JC incorrectly at receiver i does 
not account for an error. ■ 
Now, in the strong interference regime, the superposition coding configuration is to make 
whole message be common for both users i = 1,2; in words, there is no superposition 
eventually. One-round strategy STGoneRound yields achievable rate region ^oneRound* which 
consists of nonnegative (Ri, R 2 ) satisfying 

R 2 < min{J(x 2 ;2/ 1 |a; 1 ) + (C 21 - £i) + , I (x 2 ; yi, falxx)} 

Rt < min{/(xi;?/i|x2) + (C 21 - £i) + , I (xi] yi, fa\x 2 )} 

Ri + R 2 < min{l (x 1 ,x 2 ;yi) + (C^ - £i) + , / (x 1 , x 2 ; y x , fa)} 

(73) 

R x < mm{l (x 1 ;y 2 \x 2 ) + (Cf 2 - £ 2 )+, I (xi, y 2 , fa\x 2 )} 

R 2 < mxn{l{x 2 \y 2 \x 1 ) + (Cf 2 - &) + , I (x 2 ;y 2 ,y 1 \x 1 )} 

R 2 + Ri< min {I (x 2 , xi,y 2 ) + (Cf 2 - £ 2 ) + , I (x 2 , x x ; y 2 , fa)} , 
where & = 1, for both i — 1, 2. 



Comparing e^oneRound with the outer bounds in Lemma 5.1 one can easily conclude that 
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Lemma 5.11 (Strong interference rate region): 

^OneRound C if C V C ^QneRound © ([0, 1] X [0, 1]) , (74) 

in the strong interference regime. Besides, ^oneRound 

Proof: We investigate the bounds in ^oneRound and claim that: 
Claim 5.12: The bounds in ^oneRound satisfies: 

• i?i bound is within 1 bit to outer bounds; 

• R 2 bound is within 1 bit to outer bounds; 

• Ri + R 2 bound is within 2 bits to outer bounds. 

Proof: See Appendix |Cj ■ 
This completes the proof. ■ 

F. Approximate Capacity of Compound MAC with Conferencing Decoders 

One of the contribution in this work is characterizing the capacity region of compound multiple 
access channel with conferencing decoders (CMAC-CD) to within 1 bit. The channel is defined 
as follows. 

Definition 5.13: A compound multiple access channel with conferencing decoders (CMAC- 
CD), is a channel with the same set-up as depicted in Fig. [2j, while both receivers aim to decode 
both mi and m 2 . 

We give straightforward cut-set upper bounds as follows: 

Lemma 5.14: If (Ri, R 2 ) is achievable, it must satisfy the following constraints: 

R x < min {log(l + SNRi) + Cf 1; log(l + INR 2 ) + C? 2 , log (1 + SNR X + INR 2 )} (75) 

R 2 < min {log(l + SNR 2 ) + C B 2 , log(l + INRi) + C B , log (1 + SNR 2 + INRi)} (76) 

Ri + R 2 < log (1 + SNRi + INRi) + C 21 (77) 

i?i + i? 2 < log (1 + SNR 2 + INR 2 ) + C B 2 (78) 

R x + R 2 < log (1 + SNRx + INRi + SNR 2 + INR 2 + \h n h 22 - h l2 h 2l \ 2 ) . (79) 

Proof: These are straightforward cut-set bounds. We omit the details here. ■ 
For achievability, we adapt the scheme proposed above with no superposition coding at 



transmitters. Therefore, the rate region is exactly the same as (73). Hence, we conclude that 
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Theorem 5.15 (Within 1 bit to CMAC-CD Capacity Region): The scheme achieves the capac- 
ity of compound MAC with conferencing decoders to within 1 bit. 



Proof: Following the same line in the proof of Lemma 5.11 t we can conclude that the 
bounds in ^oneRound satisfies: 

• Ri bound is within 1 bit to outer bounds; 

• i?2 bound is within 1 bit to outer bounds; 

• R\ + i?2 bound is within 1 bit to outer bounds. 

This completes the proof. ■ 
VI. One-Round Strategy versus Two-Round Strategy 



In Section [V] we show that the two-round strategy proposed in Section [TV] along with time- 
sharing achieves the capacity region to within 2 bits universally. One of the drawbacks of the two- 
round strategy, however, is the round-trip delay. The quantize-binning receiver cannot proceed 
to decoding until the other receiver decodes and forwards the bin indices back. The round-trip 
delay is two times the block length, which can be huge. To avoid such huge delay, fortunately 



in some cases, the one-round strategy STGo nc Round described in Section |V-E suffices. One of 



such cases is the strong interference regime. This can be easily justified in the corresponding 
linear deterministic channel (LDC). At strong interference, all transmitted signals in the LDC are 
common. There is no useful information lies below the noise level since the signal is corrupted by 
the noise. Hence, quantize-binning at the noise level is sufficient to convey the useful information. 
Another such cases is the symmetric set-up, where 

SNR = SNRi = SNR 2 , INR = INR X = INR 2 ; C B = C? 2 = C^. (80) 

For the symmetric set-up, a natural performance measure is the symmetric capacity, defined 
as follows: 

Definition 6.1 (Symmetric Capacity): 

C sym :=suv{R:(R,R)etf}. (81) 

It turns out that the one -round strategy suffices to achieve C sym to within a constant number 
of bits. 

Theorem 6.2 (Constant Gap to the Symmetric Capacity): 
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The one-round strategy STG 0n oRound can achieve the symmtric capacity to within 3 bits. 
Proof: See Appendix |D} ■ 

The justification in the corresponding LDC is again simple. Since the performance measure in 
which we are interested is the symmetric capacity, we can without loss of generality assume that 
both transmitters are transmitting at full private rate, that is, the entropy of each user's private 
signals is equal to the number of levels below the private signal level. Therefore at each receiver, 
there is no useful information below the private signal level, and quantize-binning at the private 
signal level suffices to convey the useful information. 

VII. Generalized Degrees of Freedom Characterization 

With the characterization of the capacity region to within a constant number of bits, we 
attempt to answer the original fundamental question: how much interference can one bit of 
receiver cooperation mitigate? For simplicity, we consider the symmetric set-up. 



By Lemma 5.1 and Theorem 5.4, we have the characterization of the symmetric capacity to 
within 2 bits: 

Corollary 7.1 (Approximate Symmetric Capacity): Let C sym be the minimum of the below 
four terms: 

log(l + SNR) + min |c B , log (l + j^r) } , (82) 
logfl + INR+-^M+C B , (83) 



1 + INR 

1 1 / SNR \ 1 

- log (1 + SNR + INR) + - log (l + ) + -C B , (84) 

- log (1 + 2SNR + 2INR + \huh22 - h 12 h 2 i\ 2 ) . (85) 
Then, C sym — 2 < C sym < C sym . 

A. Generalized Degrees of Freedom 

To study the behavior of the system performance in the linear region, we use the notion of 
generalized degrees of freedom (g.d.o.f.), which is originally proposed in [3|. A natural extension 
from the definition in [|3l would be the following: let 

r lQ S INR r C B 

lim - — — — = a; hm — — = k, (86) 

SNR^oologSNR SNR^oologSNR 
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and define the number of generalized degrees of freedom per user as 

d:= lim (87) 
fix a,K logSNR 
SNR^oo 

if the limit exists. With fixed a and k, however, there are certain channel realizations under 
which ( [87] ) has different values and hence the limit does not exist. This happens when a — 1, 
where the phases of the channel gains matter both in inner and outer bounds. In particular, its 
value can depend on whether the system MIMO matrix is well-conditioned or not. 

From the above discussion we see that the limit does not exist, since for different channel 



phases and different INR settings the value of (87) may be different. The reason is that, the 



original notion proposed in [3] cannot capture the impact of phases in MIMO situations, while 



from Corollary |7.1| we see that our results depend on phases heavily, if the receiver-cooperative 
link capacity C B is so large that MIMO sum-rate cut-set bound becomes active. Therefore, 



instead of claiming that the limit (87) exists for all channel realizations, we pose a reasonable 
distribution, namely, i.i.d. uniform distribution, on the phases, show that the limit exists almost 
surely, and define the limit to be the number of generalized degrees of freedom per user. 
Lemma 7.2: Let 

\hij\ = gij, Zhij = e i:j , e {1,2}, (88) 



where 0y are i.i.d. uniformly distributed over [0, 2tt]. Then the limit (87) exists almost surely, 
and is defined as the number of generalized degrees of freedom (per user) in the system. 

Proof: We leave the proof in Appendix [EJ ■ 
Now that the number of g.d.o.f. is well-defined, we can give the following theorem: 
Theorem 7.3 (Number of Generalized Degrees of Freedom Per User): We have a direct con- 
sequence from Corollary |7.1 



For < a < 1, 



For a > 1, 



2 

Numerical plots for g.d.o.f. are given in Fig. |7j We observe that at different values of a, the 
gain from cooperation varies. By investigating the g.d.o.f., we conclude that at high SNR, when 
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d = min <{ 1, max (a, 1 — a) + k, 1 — J> . (89) 



a + k , 

d = min ta,l + K, - )■ . (90) 
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INR is below 50% of SNR in dB scale, one -bit cooperation per direction buys roughly one-bit 
gain per user until full receiver cooperation performance is reached, while when INR is between 
67% and 200% of SNR in dB scale, one-bit cooperation per direction buys roughly half-bit gain 
per user until saturation. 

d (a, k) 




0.5 1 1.5 2 2.5 3 

a 



Fig. 7. Generalized Degrees of Freedom 

B. Gain from Limited Receiver Cooperation 

The fundamental behavior of the gain from receiver cooperation is explained in the rest of 
this section, by looking at two particular points: a — | and a — |. Furthermore, we use the 
linear deterministic channel (LDC) for illustration. 

At a = |, the plot of d versus k is given in Fig. [8j(a). The slope is 1 until full receiver 
cooperation performance is reached, implying that one -bit cooperation buys one more bit per 
user. We look at a particular point k — | and use its corresponding LDC (Fig. [8j(b)) to provide 
insights. Note that 1 bit in the LDC corresponds to \ log SNR in the Gaussian channel, and since 
C B ~ | log SNR, in the corresponding LDC each receiver is able to sent one-bit information 
to the other. Without cooperation, the optimal way is to turn on bits not causing interference, 
that is, the private bits 03,04,63,64. We cannot turn on more bits without cooperation since it 
causes collisions, for example, at the fourth level of receiver 2 if we turn on bit. Now with 
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(c) (d) 
Fig. 8. Gain from Cooperation 



receiver cooperation, we want to support two more bits ct 2 , b 2 . Note that prior to turning on 
02,62, there are "holes" left in receiver signal spaces, and turning on each of these bits only 
causes one collision at one receiver. Therefore, we need 1 bit in each direction to resolve the 
collision at each receiver. We can achieve 3 bits per user in the corresponding LDC and d = \ in 
the Gaussian channel. We cannot turn on more bits in the LDC since it causes collisions while 
no cooperation capability is left. 

At a = |, the plot of d versus k is given in Fig. [8j(c). The slope is | until full receiver 
cooperation performance is reached, implying that two-bit cooperation buys one more bit per 
user. We look at a particular point k = | and use its corresponding LDC (Fig. [8j(d)) to provide 
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insights. Note that now 1 bit in the LDC corresponds to | logSNR in the Gaussian channel, and 
since C B ~ | log SNR, in the corresponding LDC each receiver is able to sent one-bit information 
to the other. Without cooperation, the optimal way is to turn on bits ai, 03, &i, 63. We cannot turn 
on more bits without cooperation since it causes collisions, for example, at the second level of 
receiver 2 if we turn on a 2 bit. Now with receiver cooperation, we want to support one more 
bit a 2 . Note that prior to turning on a 2 , there are no "holes" left in receiver signal spaces, and 
turning on a 2 causes collisions at both receivers. Therefore, we need 2 bits in total to resolve 
collisions at both receivers. We can achieve 5 bits in total in the corresponding LDC and d = | 
in the Gaussian channel. We cannot turn on more bits in the LDC since it causes collision while 
no cooperation capability is left. 

From above examples and illustrations, we see that whether one cooperation bit buys one 
more bit or two cooperation bits buy one more bit depends on whether there are "holes" in 
receiver signal spaces before increasing data rates. The "holes" play a central role not only 
in why conventional compress-forward is suboptimal in certain regimes, as mentioned in the 
previous section, but also in the fundamental behavior of the gain from receiver cooperation. We 
notice that in lfT4ll . there is a similar behavior about the gain from cooperation as discussed in 
Section 3.2. of [|T4ll . We conjecture that the behavior can be explained via the concept of "holes" 
as well. 



C. Comparison with Suboptimal Strategies 



Pointed out by the motivating example in Section IIL conventional compress-forward and 
decode-forward are not good for receiver cooperation to mitigate interference in certain regimes, 
which are used in [fTT| | and [Q21. These suboptimal schemes include: 

(1) One-round compress-forward (CF) strategy: the conventional compress-forward is used for 
the two receivers to first exchange information and then decode. 

(2) One-round decode-forward (DF) strategy: at the first stage both receivers decode one of the 
common messages with stronger signal strength without help from the receiver-cooperative 
links, by treating other signals as noise. Both then bin-and-forward the decoded information 
to each other. At the second stage, both receivers make use of the bin index send over 
receiver-cooperative links to decode and enhance the rate. 
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1.5 1.5 




(c) k = 0.5 (d) k = 0.8 

Fig. 9. Number of Generalized Degrees of Freedom 

(3) Two-round CF+DF strategy: at the first stage one of the receivers, say, receiver 1, compresses 
its received signal and forwards it to the other receiver. At the second stage, receiver 2 
decodes with the side information received at the first round, and then bin-and-forwards the 
decoded information to receiver 1. Then at the third stage receiver 1 decodes with the help 
from receiver-cooperative links. 
Comparisons of these strategies in terms of the number of generalized degrees of freedom for 
different scaling exponents a of log I NR and k of C B are depicted in Fig.|9j None of them achieves 
the optimal g.d.o.f. universally. Note that although the two-round CF+DF strategy outperforms 
one-round CF/DF strategies, it cannot achieve the optimal number of g.d.o.f. for all a's and k's. 
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One-round strategy based on our cooperative protocol, on the other hand, is sufficient to achieve 
the symmetric capacity to within 3 bits universally and hence achieves the optimal number of 
g.d.o.f. for all a's and /c's. 
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We will first describe the strategy in detail and analyze the error probability rigorously. 

A. Description of the Strategy 

In the following, consider all i, j E {1, 2} and i ^ j. 

Codebook generation: 

Transmitter i splits its message — > (m K ,m ip ). Consider block length- N encoding. First 
we generate 2 NRic common codewords {x^,(m ic ), 1 < m ic < 2 NRio }, according to distribution 
P { x ic) = Y[n=iP{ x ic[ n }) w ^ n x ic[ n ] ~ CAf(0, Qic) for all n. Then for each common codeword 
xf c (m ic ) serving as a cloud center, we generate 2 NRi p codewords {xf(m ic , m ip ), 1 < m ip < 
2 NRi p}, according to conditional distribution p (xf\x^.) = p(xi[n]\xi C [n]) such that for all 
n, Xi[n] = Xi C [n\ + x ip [n], where x ip [n] ~ £/V(0, Q ip ) and independent of everything else. The 
power split configuration is such that Q ip + Q ic = 1, INR JP := Qi P \hji\ 2 < 1 if SNRj > INRj, 
and no such split if SNRj < INRj. Hence, Qi P = min < 1, — ^- \ if SNRj > INRj, and Q ip = 



For receiver 2 serving as relay, it generates a quantization codebook of size V3/% \ — 2 NR2 , 
randomly according to marginal distribution piij^) = J p(y2)p(y 2 ^2)^2 ^ where pijj^ly^) — 
Y[n=iP(^^[ n ]\y^[ n ]j ■ The conditional distribution is such that for all n, 2/2 H = 2/2 [n] + 22 H> 
where z 2 [n] ~ CJ\f(0, A 2 ), independent of everything else. Parameters i? 2 and A 2 are to be 



Appendix A 



Proof of Theorem 03] 




otherwise. 
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specified later. For each element in codebook W 2 , map it into {1, . . . , 2 7VC 2i} through a uniformly 
generated random mapping b 2 : & 2 — > {1, • • • , 2 Arc 2i}, y£ 1— ► Z 2 i (binning). 

(lc) (2c) 

For receiver 1 serving as relay, it generates two binning functions 6^ and b\ independently 
according to uniform distributions, such that the message set {1 < m ic < 2 NRic } is partitioned 



into 2 A i lc)7VC i2 bins, for i = 1, 2, where < Af J < 1, Ai lc} + A^ 2c) = 1, and 

: {1, . . . , 2**-} - {1, ... , 2^^}, m JC z£> G {1, . . . , 2^^}. (91) 

The superscript notation "(ic)" denotes which message set is partitioned into bins, while the 
subscript "1" denotes the binning procedure is at receiver 1. 

Encoding: 

Transmitter i sends out signals according to its message and the codebook. Receiver 2, serving 
as relay, chooses the quantization codeword which is jointly typical with y% (if there is more 
than one, it chooses the one with the smallest index), and then sends out the bin index Z 2 i for 
the quantization codeword. After decoding (mi c , mi p , m 2c ) (to be specified below), receiver 1 
sends out bin indices ^12^12^) according to binning functions (b^°\ V 

Decoding at receiver 1: 

To draw comparison with the decoding procedure in the conventional compress-forward, the 
above decoding can be interpreted as a two-stage procedure as follows. It first constructs a list 
of message triples (both users' common messages and its own private message), each element 
of which indices a codeword triple that is jointly typical with its received signal from the 
transmitter-receiver link. Then, for each message triple in this list, it constructs an ambiguity set 
of quantization codewords, each element of which is jointly typical with the codeword triple and 
the received signal. Finally, it searches through all ambiguity sets and finds one that contains a 
quantization codeword with the same bin index it received. If there is no such unique ambiguity 



set, it declares an error. The two-stage interpretation is illustrated in Fig. 10 

To be specific, upon receiving signal y\ and receiver-cooperative side information l 2 \, receiver 
i constructs a list of candidates 

L (Vi) '■= {m-= {m lc ,m lp ,m 2 c) \ (xZ( m ic),^(m lc ,m lp ),X2 C (m 2c ),y^) e A[ N) } , (92) 

where denotes the set of jointly e-typical A^-sequences, correspondingly (EH- 
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For each element m G L(y±), construct an ambiguity set of quantization codewords 

B{m) := G W 2 (y»,xUrnx c ),x»( mic ,m lp ),x£(m 2c ),y?) G A™\ . (93) 



Declare the transmitted message is m if there exists an unique m such that 3^6 £?(m) with 
62(^2^) = ^21- Otherwise, declare an error. 



Receiver 2 
Quantization 
Codewords 



List of 
Message 
Triples 



Receiver 2 
Quantization 
Codewords 




B(m 

Ambiguity Sets Binning Function 



List of 
Message 
Triples 



B (mi 

Ambiguity Sets Binning Function 



(a) Error Event (1) 
Fig. 10. Decoding at Receiver 1 and Error Events 



(b) Error Event (2) 



Decoding at receiver 2: 

After receiving bin indices l^tj, receiver 2 searches for an unique message triple 

K,m 2 p,m k ) such that (x% c (m 2c ) } x% (m 2c , m 2p ), x? c (m lc ), y£ ) G A ( e N) , and (m ic ) = 1$, 
for % = 1, 2. If there is no such unique triple, it declares an error. 

B. Analysis 

Error probability analysis at receiver 1: 

Without loss of generality, assume that all transmitted messages are l's. For simplicity, we 
first focus on the case where receiver 1 aims to decode while receiver 2 serves as a relay to help 
it decode. 
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At receiver 1, due to law of large numbers, the probability that the truly transmitted 1 : = 
(mic = l,m2 C = l,^i P = 1) ^ L(yf) goes to zero as iV — > oo. Besides, the probability that 
-B(l) does not contain the truly selected is also negligible when N is sufficiently large. 
Consider the following error events: 

First, there is no quantization codeword jointly typical with received signals. This probability 
goes to zero as N — > oo if R2 > I(y2] V2), which is a known result in the source coding literature. 

Second, there exists 1 such that both of them are in the candidate list L(y^), and the 
ambiguity set B(m) contains some quantization codeword y% with bin index b% (y^) = ^21- 
This event can further be distinguished into two cases: First, this y^ e B(m) is not the actual 



selected quantization codeword (illustrated in Fig. 10 (a)); second, this y^ E B(m) is indeed 
the selected quantization codeword (illustrated in Fig. [10} (b)). In the following we analyze the 
error probability of these two typical error events. 



Again, refer to Fig. 10 for illustration. Define error events as follows: for any nonempty 

SC {lc, lp,2c}, 

Eg := the event that there exists some 1, (where m s ^ l,Vs G S and m s = l,Vs S), 
such that m e L(y^) and B(m) contains some y^ik), fc G {1,2,..., 2 NR2 } with b 2 (y2 (k)) = 
l 2 i. Note: this y^ (k) is not the truly selected quantization codeword yjf(l). 

E s 2 ^ : = the event that there exists some (where m s ^ l,Vs G S and m s = l,Vs ^ S), 

such that m 6 L(yf) and B(m) contains (1). 

1) Probability of E^: Consider the probability of the error event Eg: 

Pt(e^\ (94) 



< N 



^ ^PT{meL(y?),y»(k)eB(Tn)Mv?(k)) = hi} (95) 



Vse5 



(a) 



£ ^Pr{(^),^(m),yf)GAf)} (97) 



Vses 1 



< 2^.€^)2-^ c « ^Pr{(^(A;),^(m),i^) G Af >} , (98) 
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where (a) is due to the independent uniform binning. 

For notational convenience we use x N (m) to denote the vector of codewords corresponding 
to message m, that is, (xf c (mi c ), xf (mi c , mi p ), sf c (rri2 C )). 

Note that for k ^ 1, y^ik) is independent of (x N (rn),y^). We then make use of Theorem 
15.2.2 in ll2"Tll . which upper bounds the volume of conditional joint e-typical set Ae (2/2 \x N , Vi) 
given that (x N ,y?) G 



^Pr{(^(A;),^(m),yf)e4 iV) } 



< 2 

< 2 

< 2 

(b) 



NR 2 



NR 2 



NR 2 



p(y?)p(x N ,y?)dy?dx N dy? 
p(x N ,y?)dx N dy? 



y?e4 N) (y 2 \x",y?) 



P(y?)dy? 



p(x N ^)dx N dy» 



< 2 N (Hm\xic,xi,x2c,yi)+2e) . 2~ iV (M!'2)-e) . 2 NR2 

2NR 2 2~ N (I{y2;xi c ,xi,x 2c ,yi)-3e) 



p(x N ,y?)dx N dy? 
p(x N ,y?)dx N dy? 



Pr {m G L(y±)} < < 



(99) 
(100) 
(101) 
(102) 

(103) 
(104) 
(105) 



(z",y?)EAl 

= Pr {m G L(yf)} ■ 2 7v52 2- JV(/( ^ 2;Xlc ' :Cl ' X2c ' J/l) " 3£) 
where (b) is due to Theorem 15.2.2 in lETTl . Besides, according to the results in 11221 . 

2-N(I(x 1 ;y 1 \x lc ,x 2c )-e') g _ f\p\ 

2-N(I(x 1 ;y 1 \x 2c )-e') g _ | lc j 

2-N(I{x 2c ;y 1 \x 1 )-e') g _ |2 c j 

2 -N(I(x 2c ,x 1 ;y 1 \x lc ye>) S={lp,2c} , (106) 

2-N(I(x 1 ;y 1 \x 2c )-e') g _ ]_ c j. 

2 -JV(/(xi,x ao) - Itt )- e ') 5 = | 2C; lc} 
2-JV(/(«i,x2c»i)-0 5 = 2c, lc} 

where e' = 4e. Note that unlike in the interference channel without cooperation as in [|22l|. here 
we require receiver 1 to decode m 2c correctly. Hence, the event when S = {2c} does cause an 
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error. Therefore, the probability of the first kind of error event vanishes as TV — > oo if 

Rip < I (xi;yi\x lc ,x 2c ) + Cfi - R 2 + I(y2;x lc ,x 1 ,x 2c ,yi) 
R 2c < I(x 2c ;yi\xi) + C21 - R 2 + I(y 2 ', x ic,xi,x 2c ,yi) 
R2c + Rip < I ( x 2c,xi,yi\x lc ) + C^i - R 2 + I(y 2 ] X\ci X\ , X 2c , 

yi) 

Ric + Rip < I (xi,yi\x 2c ) + - R 2 + I(y2;x lc ,xi,x 2c ,yi) 
Ric + R2c + Ri P < I (xi, x 2c ; yi) + C21 - R 2 + I(y 2 ; x lc , x u x 2c , yi). 
On the other hand, since we can rewrite 

Pr{4 1} }< 



?r{me Htf )} • Pr {3 k ± l,y?(k) G B(m),b 2 (y$ r (k)) = l 21 



m G 



<2 JV (^^)Pr{mGL(yf)}. 

Hence, the probability of the first kind of error event vanishes as N — > 00 if 

< I {xi\yi\x lc ,x 2c ) + ^Cfi -R 2 + I(y 2 ; X\ci X±, X 2c , 



R2c < I [x 2c - y x \x x ) + (C^ -R 2 + I(y 2 

Vi) 

R2C + Ri P < I (x 2c ,x 1 ;yi\x lc ) + - R 2 + I(y2;x lc ,x 1 ,x 2 c,yij^ 

Ric + Rip < I (xi;yi\x 2 c) + (c^ - R 2 + I(y2;x lc ,x 1 ,x2 C ,yij S ) 

Ric + R2c + Ri P <I (xi,x 2c ] yi) + (Cn -R2 + I(y 2 ] X\ci Xi, X 2c , 

Finally, plug in R 2 = I(y 2 ; y 2 ) and by Markov relation: (x lc , x 1: x 2c , y x ) -y 2 - y 2 , we get the 
rate loss term 

6 : = R2 - Hy2;xi c ,x 1 ,x 2c ,yi) = /(jfojfe) - I(y2;x lc ,x 1 ,x 2c ,yi) 
= I(y2;y 2 \xic,x 1 ,x 2 c,yi)- 
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(2) (2) 

2) Probability of Eg': Consider the probability of the error event Eg': 
Pr{4 2) }< E Pr{y?(l)eB(m),meL(y?)} 

rn:m s ^l,VsSS 



E Pr{(^(l),^(m),^) 






m : m s ^ 1 , V s £ S" 








' 2 Jv(E. 6S «.) 


. 2^ N ( I ( x iiyi^y2\xic,x 2c )- 


-e') C 
; O = 


i 1 ni 




, 2 _Ar (- f ( :c l^l'4'2k2c)-<:') 


5 = 


{lc} 


2 iV (D.es«-) 


. 2-^ r (-f(^2c;j/l,J(2|2:i)-e') 


s = 


{2c} 




. 2^ N ( I ( x 2c,xi;yi,y2\xi c )- 




{lp,2c} 


2 w (E 3eS R 3 ) 


, 2-^ V (- f ( :c i;S/1.4'2k2 c )-e') 


5 = 


{lp,lc} 




. Q - •^(/(aSl^BcJlftiJQ)— e0 


s = 


{2c, lc} 




. 2~ Ar (- f ( :c l> :E 2c;yi,'/2)-<:') 




{lp,2c, lc} 


the event when S = {2c} does cause an error. Hence, the 



(122) 
(123) 



(124) 



of the second kind of error event vanishes as iV — ► oo if 

Rip < I (x 1 ;y 1 ,y 2 \x 1C} X2c) 
R 2c < I (X2c,yi,y2\xi) 

R2c + -Rip < I (x 2c , Xl, VumlXic) 

Ric + Rip < I {xi\yi,y 2 \x 2c ) 
Ric + R2c + Rip < I (%i, x 2c \ yum) ■ 



(125) 
(126) 
(127) 
(128) 
(129) 



Error probability analysis at receiver 2: 

After receiving the two bin indices, receiver 2 can decode (mi c ,m 2c ,m2 P ), with effectively 
smaller candidate message sets, (namely, the bins,) for m\ c and m 2c . Following the same line 
as ll2~2~ll . it can be shown that (we omit the detailed analysis here), for all < A^ < 1 and 
1, the following region is achievable: 



R 2p < I (x 2 ;y 2 \x 2c ,x lc 



(ic) r B 



Ric + R2 P < I (x lc ,x 2 ;y 2 \x 2c ) + X\ } C 



12 



R2c + R2 P < I (x 2 ; y 2 \x lc ) + A^ 2c) Cf 2 
R2c + Ric + R2 P < I (x 2 , x lc ; y 2 ) + Cf 2 . 



(130) 
(131) 
(132) 
(133) 
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Note that the performance of decoding the private message m 2p does not gain from cooperation, 
since receiver 1 does not decode the private message iri2p. 

Taking convex hull over all possible G [0, 1]. Note that the bounds for R 2p and R 2c + 
Ric + R 2p remain unchanged. Project the three-dimensional rate region to a two-dimensional 
space for any fixed R 2p = r 2p , we see that the convexifying procedure results in the following 
region: 

Ric + r 2p < I (x lc ,x 2 ;y 2 \x 2c ) + Cf 2 (134) 
R2c + r 2p <I(x 2 ;y 2 \x lc ) + C® 2 (135) 
R2c + Ric + r 2p < I (x 2 , x lc ; y 2 ) + Cf 2 . (136) 
Hence the following rate region is achievable for receiver 2 to decode successfully: 

Rip < I (x 2 ; y 2 \x 2c , x ic ) (137) 

Ric + R2 P < I (x lc ,x 2 ;y 2 \x 2c ) + Cf 2 (138) 

R2c + R2 P <I(x 2 ;y 2 \x lc ) + C* 2 (139) 

R2c + Ric + R 2p <I (x 2 , x lc ; y 2 ) + C® . (140) 

Appendix B 
Proof of Lemma I5TT1 



(1) Bounds ( |27) on R\,R 2 

Proof: One can directly use cut-set bounds. As an alternative, we give the following proof 
in which the decomposition of mutual informations is made clear. 

We have the following bounds by Fano's inequality, data-processing inequality, and chain rule: 
if Ri is achievable, 

N(R X - e N ) (141) 

<I(x«;v?,v») <I{x»-,y»,v«,x») ® /(xf ; y? , v»\x») (142) 
® /(xf ; y?\x%) + I(x» ; u^y? , x») = h(h n x? + - h(z?) + J(xf ; , x?) (143) 

< Nlog(l + SNR 1 ) + I(x?;u£\y?,xZ), (144) 
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where e^v — > as N — > oo. (a) is due to Fano's inequality and data processing inequality, (b) is 
due to the genie giving side information xf to receiver 1, ie., conditioning reduces entropy, (c) 
is due to the fact that x± and x 2 are independent, (d) is due to chain rule, (e) is due to the fact 
that i.i.d. Gaussian distribution maximizes differential entropy under covariance constraints. 

To upper bound I(x^; u 2 \\yi ■, x 2 ), which corresponds to the enhancement from cooperation, 
we make use of the fact that u 21 is a function of (y^ ,1/2)' 

7(xf;<|yf,^) (145) 

= h(x»\y?,x») - h(x»\ug,y?,x») < h{x»\y>! ,af) - h(x»\ug,y? ,x» ,y») (146) 
( = } h{x»\y»,x») - h{x»\y»,x»,y») = I(xf; y»\y?, x») (147) 
= h{y»\y»X) ~ h(y?\y?,x»,x») = h(h 21 x? + z?\h n x? + - h{z») (148) 

^ log ( 1 + rrik)- (149) 

(a) is due to the fact that conditioning reduces entropy, (b) is due to the fact that u 2l is a function 

of {y?,y?). 

Besides, it is trivial to see that I (x± ; u 21 \y± , x 2 ) < H{u 2l ) < NC 21 . Hence, (and similarly 



for R 2 ) 

1 + SNRx 
1 + SNR^ 



R, < log(l + SNR X ) + min { C 2 B 1; log ( 1 + - ™** p ) } (150) 
R 2 < log(l + SNR 2 ) + min <j C? 2) log ( 1 + - ) } (151) 



(2) Bounds (22) on R\ + R 2 



Proof: Define 

sx := h 21 xi + z 2 , s 2 := h 12 x 2 + z 1} (152) 
Si := h 2 iXi + z 2 , s 2 := hi 2 x 2 + ii, (153) 

where zi,z 2 are i.i.d. CJ\f(0, l)'s, independent of everything else. Note that Sj and 3j have the 
same marginal distribution, for z = 1, 2. 



A genie gives side information to receiver z (refer to Fig. 11 ) Making use of Fano's in 



equality, data processing inequality, and the fact that Gaussian distribution maximizes conditional 
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Fig. 11. Side Information Structure for Bound (22} 



entropy subject to conditional variance constraints, we have: if (i?i,i?2) is achievable, 



N(R 1 + R 2 - ejv) (154) 

< I(x? ; yf , u£) + I(x»; yf, u£) (155) 
^ /(xf ; yf ) + /(^; yf ) + J(xf ; <|yf ) + ug|yf ) (156) 

< I(xf ; yf , sf ) + /(xf; yf, 5*) + ffg) + H « 2 ) (157) 

(d) 

< %f, Sf ) - ^(4, Sf) + %f, 3*) - h(s», if) + iVC* + NC B l2 (158) 
( => %f |Sf ) + /»(3f) - - + / i (y 2 v |5 2 v ) + fc(3f ) - fc(^) - /i(?f ) (159) 

+ NC^ + NC B 2 (160) 

= %f |Sf ) - h{z») + h{v»\5») - h{z^) + NCl + NC B 12 (161) 



" ^ I 1 ^ OT) + * I 1 + ^ + OT) + C ° + C ° } • ^ 
where — > as N — ► oo. (a) follows from Fano's inequality and data processing inequality, 
(b) is due to chain rule, (c) is due to the genie giving side information "sf to receiver i, i = 1, 2, 
and I(xf- ufi\yf) < H(u^). (d) is due to the fact that H(u%) < NCf { . (e) is due to chain rule, 
(f) is due to the fact that i.i.d. Gaussian distribution maximizes conditional entropy subject to 
conditional variance constraints. Note that alternatively the genie can give side informations sf 
to receiver i, as in J3]|. 
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Hence, 



R 1 + R 2 <\og[ I + INR1 + 



C B +C B 

^21 ' ^19- 



12- 



SNRi 

+ I NR.; 



+ log 1 + INR 2 



SNR 2 



INRi 



(163) 
(164) 



(3) Bounds (23) on Ri + R 2 



z N 




Fig. 12. Side Information Structure for Bound (123 



Proof: A genie gives side information x 2 and y 2 to receiver 1 (refer to Fig. 12 ) Making use 
of Fano's inequality, data processing inequality, the fact that u 2l is a function of (yf ,y 2 ), an d 
the fact that Gaussian distribution maximizes conditional entropy subject to conditional variance 



November 11, 2009 



DRAFT 



47 



constraints, we have: if (Ri,R 2 ) is achievable, 

N(Ri + R 2 - e N ) (165) 

< J(af ; yf, «£) + I(af; yf, < 2 ) (166) 

< /(sfjyf.r&lM) + I{x»;y») + I{z»;v»\y») (167) 

< / (sf ; , «£, ^af ) + (yf) - (sf ) + « 2 ) (168) 
( = } / yf^K) + h (y») - h ( S f ) + # « 2 ) (169) 
= h (hu*? + z?, sf ) - /i (zf, ^) + h (yfj - h (sf ) + («£) (170) 
= ft (fcuarf + zf|sf ) " & ^) + & M + # «) (171) 

< JVlogf 1 + - SN ,^ D ) + iVlog(l + SNR 2 + INR 2 ) + iVCf 2 , (172) 



1 + INR 2 

where e^r — > as iV — ► oo. (a) is due to chain rule and the genie giving side information x 2 and 
y 2 to receiver 1. (b) is due to the fact that x± and x 2 are independent, and I (x 2 ; u^ 2 \y 2 ) < 
H(ui 2 ). (c) is due to the fact that u 2l is a function of (yi,y 2 )- 

Hence, (and similarly if we gives side information x^ to receiver 2), we have 

Ri + R 2 < log (1 + SNR 2 + INR 2 ) + log (l + 1 ^ R ) + Cf 2 (173) 

SNR 2 \ , rB 



Ri + R 2 < log (1 + SNRi + INRi) + log ( 1 + - - ^ ) + C* (174) 



(4) Bounds $24} on R x + R 2 

Proof: This is straightforward cut-set upper bound: if (R 1 ,R 2 ) is achievable, 

N(R 1 + R 2 - e N ) (175) 

< / {xf , x»; y» , tf) = h (yf , y?) - h (zf , ^) (176) 

< iVlog (1 + SNRx + SNR 2 + INRi + INR 2 + \h u h 22 - h 12 h 21 \ 2 ) , (177) 

where e^v — > as iV — > oo. 
Hence, 

R! + R 2 < log (1 + SNRi + SNR 2 + INR a + INR 2 + \h n h 22 - ^i 2 ^ 2 i| 2 ) . (178) 
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(5) Bounds (1251) on 2R 1 + R 2 and R x + 2R 2 




jv 



DEC 2 



Fig. 13. Side Information Structure for Bound |25 



Proof: A genie gives side information and to one of the two receiver l's, and side 
information to receiver 2 (refer to Fig. 13.) Making use of Fano's inequality, data processing 



inequality, the fact that is a function of {Ui iV^), an d the fact that Gaussian distribution 
maximizes conditional entropy subject to conditional variance constraints, we have: if (R 1 , R 2 ) 
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is achievable, 

N(2R 1 + R 2 - e N ) 

(a) 



(179) 
(180) 



< I(x»; y», <) + I(z»; yf , <) + yf, < 2 ) 

< yf , «£, yf, s?) + 7(af ; yf ) + y 2 ", 4) + < |y?) + «E|y?) 

(181) 

< 7(xf ; yf , < y^l^) + 7(xf ; yf ) + yf, a?) + 77 «) + 77 « 2 ) (182) 
( = } 7(xf; yf , yfl^) + yf ) + yf, + 77 «) + 77 « 2 ) (183) 
= h (h llX » + z», S f ) - h + %f ) - /i(sf) + % 2 ", 8 ») - his", (184) 

+ 77«)+77« 2 ) (185) 



= h fax? + z?\8») - h + h( y ?) + - h(z?) + 77 «) + 77 « 2 ) 

SNRx 



< N< log 1 



1 + INR 2 



log (1 + SNR X + INRi) + log 1 + INR 2 



SNR 2 
1 + INRi 



(186) 
(187) 



+ C* + C 



12 (i 



(188) 



where — > as iV — > oo. (a) follows from Fano's inequality and data processing inequality, 
(b) is due to chain rule and the genie giving side information and y 2 to one of the receiver 
l's and side information to receiver 2. (c) is due to the fact that independent and 

I{xf ;^|yf) < H(u$). (d) is due to the fact that ug is a function of (y?,y£). 
Hence, 



2i2i + 7? 2 < log 1 + INR 2 + 



SNR, 



1 + INRi 



+ log 1 + 



SNRx 
1 + INR 2 



+ log (1 + SNRi + INRi) + C 21 + C 



12 



Similarly, 



Ri + 2R 2 < log ( 1 + INRi + 



SNRi 



1 + INR 2 



log 1 + 



SNR, 



1 + INRi 



+ log(l + SNR 2 + INR 2 ) + Cf 2 + C 



21 



(189) 
(190) 

(191) 
(192) 
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(6) Bounds (BSp on 2R 1 + R 2 and R x + 2R 2 



~N 



*<+> 



*n A yf ^ 




Fig. 14. Side Information Structure for Bound 



Proof: A genie gives side information sf,yf to receiver 1, and side information yf to 



IV 



one of the receiver 2's (refer to Fig. 14 ) Making use of Fano's inequality, data processing 
inequality, the fact that functions of (yf , yf ), and the fact that Gaussian distribution 

maximizes conditional entropy subject to conditional variance constraints, we have: if (R 1 , R 2 ) 
is achievable, 



N(R 1 + 2R 2 



< J(xf ; yf , «£) + J(xf ; yf , < 2 ) + J(xf ; yf , < 2 ) 

< I(xf;yf,t4,yf ,Sf) + J^y^^yf) + I(x?;y») + I(x»;u»\y?) 

(b) 



< J(xf ; yf , < x , yf |3f ) + /(*»; 3? ) + I(x? ; yf , < 2 , yf ) + I(x? ; yf ) + H(u N l2 

< J(xf ; yf , yf |3f ) + I(xf ; yf, yf) + M?f ) - + %f ) - h{s?) + NC B 12 

< /(xf ; yf , yf |?f ) + J(xf ; yf , yf |xf , ?f ) + /.(yf ) - ^f ) + iVCf 2 
= /(xf , xf ; yf , yf |?f ) + %f ) - ^f ) + NC B 12 

= %f , y*\s N x ) + Kv?) - h{£, ?$) - h(z») + nc b 12 



(e) 

< N log 1 



SNRi 



+ INR! + SNR 2 + 



INR, 



1 + INR 2 

+ iV log (1 + SNR 2 + INR 2 ) + NC± 2 , 



1 + INR 2 



+ 



\hnh 22 — hi 2 h 2 \\ 
1 + INR 2 



(193) 
(194) 

(195) 

(196) 

(197) 

(198) 
(199) 
(200) 

(201) 
(202) 
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where — > as N — > oo. (a) is due to the genie giving side information ^i,y 2 to receiver 
1, and side information y^ to one of the receiver 2's. (b) is due to chain rule and the fact that 
I(x 2 ;Ui 2 \y 2 ) — H(ui 2 )- (c) is due to the fact that u 2l and uf 2 are both functions of (y±,y 2 ), 
and that H{u^ 2 ) < NCf 2 - (d) is due to the fact that conditioning reduces entropy and that x 2 and 
(xi , Si) are independent, (e) is due to the fact that Gaussian distribution maximizes conditional 
entropy subject to conditional variance constraints. 
Hence, 



Ri + 2R 2 < log 1 + 



SNRi 



Ri + SNR 2 + 



INRo 



1 + INR 2 
+ log(l + SNR 2 + INR 2 ) + Cf 2 

Similarly, 

2i?i + i? 2 < log (1 + 



I NR, 



+ 



\hnh22 — ^12^21 I 
1 + INRo 



SNR 2 



+ INR 2 + SNRi + 



INRi 



1 + INRi 
+ log (1 + SNRi + INRi) + C 21 



1 + INRi 



+ 



\hnh22 — ^12^-21 1 
1 + INRi 



(203) 
(204) 

(205) 
(206) 



Appendix C 

Proof of Claim [576] , Claim |5.7j Claim [5T9| and Claim |5~T2 



A. Proof of Claim 5. 6 



Proof: To show (a), since we have four possible Ri + 2R 2 bounds, we distinguish into 4 



cases: 



(1) If the bound 

Ri + 2R 2 < I (x 1 ,x 2c ;yi\x lc ) + I (x lc ,x 2 ; y 2 ) +1 (x 2 ; 2/ 2 |^i c , x 2c ) + Cf 2 + (C^ - £i) + (207) 
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is active, note that the point (77*, R* 2 ) where the Ri + 2R 2 bound and the 2R 1 + R 2 bound (|40j) 
intersect, satisfies 



377* + 3R* 2 

= I (x 1 ,x 2c ; 2/1,2/2) + I (x 1 ;yi\x lc ,x 2c ) + 7 (xi c , x 2 \ y 2 \x 2c ) + C 



12 



+ 7 (xi, x 2c ; yi\x lc ) + I (xic, x 2 ; y 2 ) + I (x 2 ; y 2 \x lc , x 2c ) + C B 2 + (C^ - fi) 

I {xi, x 2c ; j/i, j? 2 ) + I (aJ 2 ; 2/2 kic, ^2 C ) 

+ J (^x; yi\x lc , x 2c ) + 7 (xi c , x 2 ; y 2 ) + C B 2 

+ /(a;i,X2 C ;2/i|xi c ) + I (x lc , x 2 ; y 2 \x 2c ) + C B 2 + (C 21 -£i) + 



(34) + (37) + (35) 



(208) 
(209) 
(210) 
(211) 
(212) 
(213) 
(214) 



which is greater than three times the active sum rate bound. 



(2) If the bound 

Ri + 2R 2 < I (xi,x 2c ;yi\x lc ) + I (x 2c ; + I (xi c , x 2 ; y 2 \x 2c ) + I (x 2 ;y 2 \x lc ,x 2c ) (215) 

+ C° +(C? 1 -fc) + (216) 



is active, note that the point (77*, R 2 ) where the R x + 277 2 bound and the 277 x + R 2 bound ( |40[ ) 
intersect, satisfies 



377* + 3R* 2 

= I(xi,x 2c ;yi, j? 2 ) + /(xi;2/i|xi c ,x 2c ) + 7 (x lc , x 2 ; 2/ 2 |x 2c ) + C 



12 



+ I (x 1 ,x 2c ; yi|zi c ) + 7 (x 2c ; + 7 (a: lc , x 2 ; y 2 |x 2c ) + 7 (x 2 ; y 2 \x lc , x 2c ) 

+ C B 2 +(C B 1 -£ 1 ) + 

7 (xi, x 2c ; yi, y 2 ) + 7 (x 2 ; 3/2 kic, x 2c ) 

+ I{xi,yi\x lc ,x 2c ) + 1 {X2e;yi\xi) + 1 (x lc ,x 2 ;y 2 \x 2c ) + C B 2 
+ I {xi,x 2c ;yi\xi c ) + I {x lc ,x 2 ;y 2 \x 2c ) + C B 2 + (C 21 -£i) + 



(34) + (38) + (35) 



(217) 
(218) 
(219) 
(220) 
(221) 
(222) 
(223) 
(224) 



which is greater than three times the active sum rate bound. 
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(3) If the bound 



Ri + 2i? 2 <I(xi, x 2c ; yi,m\xic) + I {%ic, x 2 ; y 2 ) + 1 {x 2 ; 3/2 kic, ^2 C ) + C 



12 



(225) 



is active, note that the point (R\, R* 2 ) where the i?i + 2i? 2 bound and the 2i?i + i? 2 bound ( |40[ ) 
intersect, satisfies 



3i?i + 3i?2 

= I (x 1 ,x 2c ;yi,y2) + I (x 1 ;y 1 \x lc ,x 2c ) + I (x lc ,x 2 ; y 2 \x 2c ) + C 



12 



+ I(xi,X2 C ; yi,y 2 \%ic) + 1 (xi c ,x 2 ;y 2 ) + I (x 2 ; y 2 \x lc , x 2c ) + Cf 2 
I (xi, x 2c ; y h y 2 ) + / (x 2 ; y 2 \x lc , x 2c ) 



+ I{x 1 ] yi\x lc , x 2c ) + / (x lc , x 2 ; y 2 ) + C 



12 



+ 1 (x 1 ,x 2c ;yi,y2\xi c ) + 1 (x lc ,x 2 ;y 2 \x 2c ) + C 



12 



(34) + (37) + (36) 



(226) 
(227) 
(228) 
(229) 
(230) 
(231) 
(232) 



which is greater than three times the active sum rate bound. 



(4) If the bound 



Ri + 2R 2 < 

I(xi,x 2 c, yi,y 2 \x lc ) + I (x 2c ; yi\xt) + I (x lc , x 2 \ y 2 \x 2c ) + I (x 2 ; y 2 \x lc , x 2c ) + Cf 2 



(233) 
(234) 



is active, note that the point (RI, i? 2 ) where the R x + 2i? 2 bound and the 2R X + R 2 bound ( |40[ ) 
intersect, satisfies 



3RI + 3R* 2 

= I (x u x 2c ; y u y 2 ) + I (xi, yi\x lc , x 2c ) + / (x lc , x 2 ; y 2 \x 2c ) + C 



12 



(235) 
(236) 



+ 1 (xx^^y^y^Xic) + I {x 2c ]yi\xi) + I (x lc ,x 2 ;y 2 \x 2c ) + I (x 2 ; y 2 \x lc , x 2c ) + Cf 2 (237) 
I {xi, x 2c ; 2/1, y 2 ) + / (x 2 ; y 2 \x lc , x 2c ) (238) 



+ I (xi;yi\x lc ,x 2c ) + I(x2c,yi\xi) + Hx lc ,x 2 ;y 2 \x 2c ) + C 



12 



+ 1 {xi,x2c;yi,y 2 \xi c ) + I (x lc ,x 2 ;y 2 \x 2c ) + C 



12 



(34) + (38) + (36) 



(239) 
(240) 
(241) 
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which is greater than three times the active sum rate bound. 

Hence, we conclude that in case (a), the corner point where Ri + R 2 bound and R\ + 2R 2 
bound intersect can be achieved. 

To show (b), since we have two possible R 2 bounds, we distinguish into 2 cases: 



(1) If the bound 



R2 < I (x 2 ;y 2 \x lc ) + C 



12 



(242) 



is active, note that the point (Rl, R^) where the R 2 bound and the 2Ri + R 2 bound ((40]) intersect, 
satisfies 



2R\ + 2R* 2 

= I (xi, x 2c ; y 1 , y 2 ) + I [x X ] yi\x lc) x 2c ) + / (x lc , x 2 ; y 2 \x 2c ) + C 

+ 1 (x 2 ;y 2 \x lc ) + Cf 2 
= / (xi, x 2c ; yi, y 2 ) + / (x 2 ; 2/2^10 x 2c ) 



12 



+ 1 {x 1 ;y 1 \x lc ,x 2c ) + I (x lc ,x 2 ;y 2 ) + C 



12 



+ I (x 2 ;y 2 \x lc ) + I (x lc ;y 2 \x 2c ) - I (z lc , x 2 ; y 2 ) + C 



12 



(34) + (37) + 



I (xic, y2\x 2c ) - 1 (xic] y-i) + C 



12 



> (1341) + ([37]) 



which is greater than two times the active sum rate bound. (**) is due to 

I (xic] y2\x 2c ) = I (xic] y 2 , x 2c ) - I (x lc ; x 2c ) = I (x lc ; y 2 , x 2c ) 

> I (Xlc, 2/2) , 

since x\ c and x 2c are independent. 
(2) If the bound 



(243) 
(244) 
(245) 
(246) 
(247) 
(248) 
(249) 

(250) 

(251) 
(252) 



R 2 < I (x 2c ; yi\xi) + I (x 2 ;y 2 \x lc ,x 2c 



(253) 
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is active, note that the point (R{, R* 2 ) where the R 2 bound and the 2Ri + R 2 bound < |40] ) intersect, 
satisfies 



2R\ + 2R* 2 

= I (x 1 ,x 2c ;yi,y2) + Hx 1 ;yi\x lc ,x 2c ) + I (x lc ,x 2 ;y 2 \x 2c ) + C 

+ I (x 2c ;yi\xi) + I (x 2 ;y 2 \x lc ,x 2c ) 
= I {x x , x 2c ; yi, y 2 ) + / {x 2 ; y 2 \x lc , x 2c ) 

+ 1 {xi,yi\xi c , x 2c ) + 1 {x 2c ;yi\x 1 ) + I (x lc ,x 2 ;y 2 \x 2c ) + Cf 2 



12 



(34) + (38) 



(254) 
(255) 
(256) 
(257) 
(258) 
(259) 



which is greater than two times the active sum rate bound. 

Hence, we conclude that in case (b), the corner point where R\ + R 2 bound and R 2 bound 
intersect can be achieved. ■ 



B. Proof of Claim 5. 7 

Proof: (Keep in mind A 2 = max{SNR 2p , 1}) 

(1) Ri bound: We have two bounds. First, / {x\\ y\\x 2c ) = log ^1 + 
bits to the upper bound log (1 + SNRi + INR 2 ). Second, 



SNRi 



1+INR 



I (x^ytlx-tcX^) + 1 (x lc ,x 2 ;y 2 \x 2c ) + Cf 2 



= log ( 1 + 
> lo 



SNR 



i P 



l + INR lp 
1 + SNR! + INR 2 



log 



1 + SNR 



■2 P INR 2 \ +( ~b 



1 + INR 2p 



12 



I. 



1 + INR lp 

Hence, if the second bound is active, it is within 2 bits to the upper bound 
log (1 + SNRi + INR 2 ). 



which is within 2 

(260) 
(261) 

(262) 
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(2) R 2 bound: We have two bounds. First, / (x 2 ; y 2 |zic) + Cf 2 = log (l + ijjjSj^ ) + Cf 2 . If the 
first bound is active, it is within 2 bits to the upper bound log (1 + SNR 2 + INRi). Second, 

I (x 2c ; yi \xi) + 1 (x 2 ; y 2 |zi c , x 2c ) (263) 
= log f 1 + IN M + log fl + SNR 2p + INR 2p X 

+ (265) 



l + INR 2p 

Hence, the second bound is within 2 bits to the upper bound log (1 + SNR 2 + INRi). 

(3) Ri + R 2 bound: We have six bounds for R 1 + R 2 , investigated as follows: 
• First, 

I {x l ,x 2c ;yi) + I (x 2 ;y 2 \x lc ,x 2c ) + (C 21 - £i) + (266) 
/l + SNRi + INRi\ / SNR 2p \ , B .+ 

= log { i + inr 1p J + log i 1 + tttnrJ + - 6) ' (267) 

which is within 2 + log 3 = log 12 bits to the upper bound 



Ri + R 2 < log (1 + SNRi + INRi) + log + + (268) 



• Second, 



I (xi, x 2c ] y u y 2 ) + I (x 2 ; y 2 \x lc , x 2c ) (269) 

_ , f (l + A 2 )(l + SNRi + INRi) + SNR 2 + INR 2 + \h u h 22 - h l2 h 2l \ 2 \ 

H (l + A 2 )(l + INR lp ) + SNR 2p ) (Z/U) 

M 1 + ™J (271) 

W . /I + SNRx + INRi + SNR 2 + INR 2 + \h u h 22 - h 12 h 21 \ 2 \ 

* l0g { ^ ) (272) 

+ log(l + SNR 2p )-l (273) 

= log (1 + SNRi + INRi + SNR 2 + INR 2 + \h u h 22 - h 12 h 21 \ 2 ) (274) 

+ log (i±|^)-loglO (275) 

(b) 

> log (l + SNRi + INRi + SNR 2 + INR 2 + \h\\h 22 — h 12 h 2 i\ 2 ) - log 10, (276) 

where (a) is due to (1 + A 2 )(l + INR lp ) + SNR 2p < (1 + A 2 )2 + A 2 < 5A 2 since A 2 = 
max{SNR 2p , 1} and INR ip < 1. (b) is due to A 2 = max{SNR 2p , 1} < 1 + SNR 2p . 
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This lower bound is within log 10 bits to the upper bound 

R 1 + R 2 < log (1 + SNRi + INRi + SNR 2 + INR 2 + \h u h 22 - h 12 h 21 \ 2 ) . 

• Third, 

I (x 1 ,x 2c ;yi\x lc ) + I (x lc ,x 2 ;y 2 \x 2c ) + C B 2 + (C 21 -£i) + 

/l + SNR^+INRi\ ^ l + SNRap + INRa ^ rB , B y 

= bg I 1 + INR 1P J + bg { l + INR 2p J + C » + " 

which is within 2 + log 3 = log 12 bits to the upper bound 

Ri + R 2 < log (l + INRi + - SN ,^ ^ + log f 1 + INR 2 + SNR " 



1 + INR 2 J ° V 1 + INRi 



+ C B + C B 

r ^21 ^ *-12- 



• Fourth, 



I (xi, x 2c ; y 1 , y 2 \x lc ) + I (x lc , x 2 ; y 2 \x 2c ) + C B 2 
= ^(aJ2 C ;yi,S/2kic) +-^(a;i;j/i,J/2|a;ic,aJ2c) + I(x lc ,x 2 ; y 2 \x 2c ) + C B 2 

> J(x 2c ;y 2 |a;i c ) + I (xi, yi\x lc , x 2c ) + / (x lc , x 2 ; y 2 \x 2c ) + C B 2 

(a) 

> I (x 2c ;y 2 \x lc ) -1 + I (x 1 ;y 1 \x lc ,x 2c ) + I (x lc , x 2 ; y 2 \x 2c ) + C B 2 

(b) 

> I {xi,yi\xi c ,x 2c ) + I (x lc ,x 2 ;y 2 ) + C B 2 - 1 



1 + SNR 2 + INR 2 
1 + INR 2p 



C B - 1 



which is within 3 bits to the upper bound 

NRo^l 4- Iop- I 1 4- 

1 + INR 2 
1 + A 2 + INR 2p + SNR 



Ri + R 2 < log (1 + SNR 2 + INR 2 ) + log ^1 + + Ci B 2 . 

Note that (a) is due to 



I (x 2c ;y 2 \x lc ) = log 
> log 



1 + A 2 + INR 2p + SNR 2p 
l + INR 2p + SNR 2 



l + (l + SNR 2p ) + INR 2p + SNR 2P/ 
^ l + INR 2p + SNR 2 ^ 
* l0g ll + INR 2p + SNR 2p J " 1 = 1 ^ V ^ ~ 1 
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(b) is due to 

I (x 2c ; V2\xi c ) + I (xic, x 2 ; y 2 \x 2c ) = I (x 2c ; 2/2, x lc ) + I (x lc , x 2 ; y 2 \x 2c ) 
> I(x 2c ;y 2 ) + 1 (x lc ,x 2 ;y 2 \x 2c ) = I (x lc , x 2 , x 2c ; y 2 ) 
= I (x lc ,x 2 ;y 2 ) . 

. Fifth, 



I (xi; y x \x lc , x 2c ) + / (x lc , x 2 ; y 2 ) + C 



12 



SNR lp \ /1 + SNR 2 + INR 2 \ _ B 



which is within 2 bits to the upper bound 



Ri + R 2 < log (1 + SNR 2 + INR 2 ) + log ( 1 + ) + Cf 2 . 



. Sixth, 



/(xi;yi|xi c ,x 2c ) + I (x2c,yi\xi) + I (x lc , x 2 ; y 2 \x 2c ) + Cf 2 

SNR lp \ /l + INRi\ /l + SNR 2p + INR 2 



SNR lp \ / 1+SNR 2 + INR 2 \ B 



£ '° S ' 1 + iTINrJ + '° g ( (1 + INR„)(1 + INR 2p ) ' + C "' 



which is within 3 bits to the upper bound 

Ri + R2 < log (1 + SNR 2 + INR 2 ) + log + - ) + C f 2 . 

(4) 2R 1 + R 2 bound: The bound 



I (xi,x 2c ;yi) + I (xi;yi\x lc ,x 2c ) + 1 {x lc ,x 2 ;y 2 \x 2c ) + Cf 2 + (C 21 - £1) 

. /I + SNRi + INRA / SNR lp \ + SNR 2p + INR 2 

= lo S 1 , mr> + log 1 + , + log ' 



l + INRi p J ta V l + INRi p ; ta V l + INR 2p 
+ Cf 2 +(C 2 B 1 -6) + , 
which is within 3 + log 3 = log 24 bits to the upper bound 

2R X + R 2 < log (l + INR 2 + SN ,^ 2 D ) + log ( 1 + 5NR ! 



1 + INRx7 V 1 + INR 2 
+ log (1 + SNRi + INRi) + C* + C* 2 . 
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(5) R\ + 2R 2 bound: We have six bounds for R 1 + 2R 2 , investigated as follows: 

• First, 

I (x 1 ,x 2c ;yi\x lc ) + I (x lc ,x 2 ;y2) + 1 (x 2 ;y 2 \x lc ,x 2c ) + C B 2 + (C 21 -£i) + (307) 
/1 + SNR 1P + INRA /1 + 5NR 2 + INRA / SNR 2p \ 

8 V i + inri p J & \ i + inr 2p J 8 v I + INR2J 

+ C B 2 +(<:*- 6) + , (309) 
which is within 3 + log 3 = log 24 bits to the upper bound 

R, + 2R 2 < log (l + IN Rl + ^L_) + log (l + (310) 

+ log (1 + SNR 2 + INR 2 ) + C B + C B . (311) 

• Second, 

I {x\,x 2c ]yi\xi c ) + I {x 2c ]yi\xi) + I (x lc , x 2 ; y 2 \x 2c ) + 1 (x 2 ;y 2 \x lc ,x 2c ) (312) 

+ C 1 B 2 +(C 2 B 1 -6) + (313) 
. /l + SNR lp + INRA / 1 + INRi \ /l + SNR 2p + INR 2 \ 

= log l i + inr 1p J +l0 HrTrNR^J +l0 H i + inr 2p J (314) 

M i+ ^) +c - +{cB ^ )+ (315) 

/l + SNR lp + INRA / 1 + SNR 2 + INR 2 \ 

£ '° g ( 1 + INR* J + '° g ((l + INR lp )(l + INR 2 J (316) 

which is within 4 + log 3 = log 48 bits to the upper bound 

ft + 2* 2 < log (l + INR, + + log (l + (318) 

+ log (1 + SNR 2 + INR 2 ) + C? 2 + C?,. (319) 
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Third, 



I (x 1 ,x 2c ; yi,y 2 \x lc ) + I (x lc , x 2 ; y 2 ) + I (x 2 ; y 2 \x lc , x 2c ) + C 12 (320) 

= , / (l + A 2 )(l + SNR lp + INRi) + SNR 2 + INR 2p + \h u h 22 - h 12 h 21 \ 2 Q lp \ 

° g V (l + A 2 )(l + INR lp ) + SNR 2p J 1 } 
, /1 + SNR 2 + INR 2 \ , / SNR 2p \ □ 

+ log ( i + .nr 2p ) + log I 1 + TTmk) + c « (322) 

^. /1 + SNRi p + INRi + SNR 2 + ^^ + 1/111/122-/112/1211^^ ..... 

^ l0g { 5A 2 ) (323) 

+ log ( ^f^R^ ) + bg (1 + SNR2P) + " 1 

> log (1 + SNR lp + INRi + SNR 2 + INR 2p + \h n h 22 - h l2 h 2l \ 2 Q lp ) (325) 

, /1 + SNR 2 + INR 2 \ a 

+ lo § " + C i2 - 1 - log 5, (326) 



l + INR 2p 

which is within 2 + log 5 = log 20 bits to the upper bound 

'^-T^-- 1 + SN R2 + i + fe^) (327) 

+ log(l + SNR 2 + INR 2 ) + C 1 B 2 . (328) 

Fourth, 

I (xi,x 2c ;yi,y 2 \x lc ) + I (x 2c ; yi\xi) + I (x lc ,x 2 ;y 2 \x 2c ) + I (x 2 ;y 2 \x lc ,x 2c ) + Cf 2 (329) 

f (l + A 2 )(l + SNR lp + INRi) + SNR 2 + INR 2p + |h n fr 22 - h i2 fe 2 i| 2 Qi p \ 

° g V (l + A 2 )(l + INR lp ) + SNR 2p ; (JJU) 

f 1 + INR^ ^ l + SNR 2p + INR 2 ^ / SNR 2p \ rB 

+ log (iTTnr^ J + log ( i + inr 2p J + log l 1 + ITTnr^ ) + c - (33 1} 

^. /l + SNRi p + INRi + SNR 2 + INR2 P + |/iii/i22-/ii2/i2i| 2 gip\ 

^ l0g 5^ J (332) 

+ log ( (i+; 5 Rai + +'l R R 2p ) ) + log (1 + SNR ^ + c& " 1 (333) 

> log (1 + SNRi p + INRi + SNR 2 + INR 2p + \h u h 22 - h 12 h 21 \ 2 Q lp ) (334) 
1 + SNR 2 + INR 2 \ g 



+ '° g l (l + INR lp )| 1 + INR 2p ) ) +C "- 1 - | °« 5 - (335) 
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which is within 3 + log 5 = log 40 bits to the upper bound 

, / SNRi INR 2 \h n h 2 2 - h 12 h 21 \ 2 \ 

log I 1 + + INRl + SNR2 + + i + inrV ) (336) 

+ log(l + SNR 2 + INR 2 ) + C B 2 . (337) 



Therefore, we see that the bounds in ^ 2 ^i^ 2 except ( [40] ) satisfies: 

• R\ bound is within 2 bits to outer bounds; 

• R 2 bound is within 2 bits to outer bounds; 

• R\ + R 2 bound is within log 12 bits to outer bounds; 

• 2Ri + R 2 bound is within log 24 bits to outer bounds; 

• R\ + 2R 2 bound is within log 48 bits to outer bounds. 



C. Proof of Claim \5.9 



Proof: (Keep in mind A 2 = 1) 

(1) Ri bound: We have two bounds. First, / {x\\ y\\x 2 ) = log (1 + SNRi), which is within 1 bit 
to the upper bound R 1 < log (1 + SNR X + INR 2 ). Second, 

I(x 1 ;yi\x lc ,x 2 ) + I (x lc ;y 2 \x 2 ) + Cf 2 (338) 

= log (1 + SNRi p ) + log ( 7 + !^ 2 ) + Of, (339) 



1 + INR 



2p 



. 1 + SNRi + INR 2 i p 
> log i TT^Td + C^ 2 . (340) 



1 + INR 2p 

Hence, if the second bound is active, it is within 1 bit to the upper bound log (1 + SNRi + INR 2 ). 
(2) R 2 bound: We have two bounds. First, I (xi;yi\xi) = log (1 + INRi), which is within 1 bit to 



the upper bound R 2 < log (1 + SNR 2 + INRi). Second, / (x 2 ; y 2 \x lc )+C* 2 = log ( 1+S 1 N + ^ R2p 



+ 



B 

12- 



Cf 2 , which is within 1 bit to the upper bound R 2 < log (1 + SNR 2 ) + C 

(3) i?i + R 2 bound: We have five bounds, investigated as follows: 
• First, 

I (an, x 2 - yx) + (C 2 B i - 6) + = log (1 + SNRi + INRi) + (C 2 B i - , (341) 
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SNR 2 , , rB 



which is within 1 + ^ = 2 bits to the upper bound 

Ri + R2 < log (1 + SNRi + INRi) + log + =J + C£. 

• Second, 

i"(xi,x 2 ;yi,y 2 ) 

. /2(1 + SNRx + INRi) + SNR 2 + INR 2 + \h n h 22 - h 12 h 21 \ 2 \ 
= bg ( 2 ) 

which is within 1 bit to the upper bound 

R 1 + R 2 < log (1 + SNRi + SNR 2 + INRi + INR 2 + \h u h 22 - h 12 h 21 \ 2 ) . 

• Third, 

I (xi, y 1 \x lc , x 2 ) + I (x lc , x 2 ; y 2 ) + C B 2 

, / m.r, \ , /1 + SNR 2 + INR 2 \ p 

= log( 1 + SNR lp)+ log( 1 + 2 )+C° 



SNRi , „ B 



which is within 1 bit to the upper bound 

Ri + R 2 < log (1 + SNR 2 + INR 2 ) + log ^1 + y^rJ + Cf 2 . 
• Fourth, 

I (x 1 ,x 2 ;y 1 \x lc ) + I (x lc ;y 2 \x 2 ) + C B 2 + (C 21 -£i) + 
= log (1 + SNR lp + INRO + log + Cf 2 + {C B 21 - 6) 

which is within 2 + £i = 3 bits to the upper bound 

Ri + i? 2 < log f 1 + INRi + - SN ,^ ^ + log (l + INR 2 + 5NR " 



1 + INR 2 / °l ' 1 + INRi 



+ C B + C B 
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. Fifth, 

I (x 1 ,x 2 ;yi,y2\xi c ) + 1 (x lc ;y 2 \x 2 ) + Cf 2 (353) 

= / (x 2 ;yi,y2\xic) + I (xi,y 1 ,y 2 \x lc ,x 2 ) + I (x lc ; y 2 \x 2 ) + Cf 2 (354) 

> I (x 2 ;y 1 ,y 2 \x lc ) + I (xi, yi|z ic , x 2 ) + I (x lc ; y 2 \x 2 ) + Cf 2 (355) 

. /2(1 + SNR lp + INRx) + SNR 2 + INR 2p + \h n h 22 - h 12 h 21 \ 2 Q lp \ 

= bg { 2(l + SNR lp) + INR 2p ) (356) 

+ log (1 + SNR lp ) + log ( ^'^J + Cf 2 (357) 

^. /l + SNR lp + INR 1 + SNR 2 + INR 2p + |/i 11 /i 22 -/i 12 /i 21 | 2 g lp \ 

" l0g { 3(l + SNR lp) ) (358) 

/ 1 + INR 2 \ _ B 



+ log (1 + SNR lp ) + log ^ 1 + |NR ^J + C?2 (359) 

> log (1 + SNRi + INRi + SNR 2 + INR 2 + \h n h 22 - h 12 h 21 \ 2 ) (360) 

+los (™;) +c "- log3 - <361) 

Hence, if this bound is active, it is within 1 + log 3 = log 6 bits to the upper bound 

R 1 + R 2 < log (1 + SNRx + SNR 2 + INR X + INR 2 + \h u h 22 - h l2 h 2l \ 2 ) . (362) 

(4) Ri + 2_R 2 bound: We have two bounds. First, 

I (x 1 ,x 2 ;y 1 \x lc ) + I (x lc ,x 2 ;y 2 ) + Cf 2 + (C 21 (363) 

= log (1 + SNR lp + INRO + log ( 1+ f^R 2 ' NR2 ) + Cf 2 + (C* - 6) + , (364) 
which is within 2 + £i = 3 bits to the upper bound 

B, + 2R 2 < log (l + INR, + ^L_) + log (l + j™*-) (365) 

+ log (1 + SNR 2 + INR 2 ) + Cf 2 + C^. (366) 

Second, 

I (x u x 2 ; yi,y 2 \x lc ) + I (x lc , x 2 ; y 2 ) + Cf 2 (367) 

= bg ^ 2(1 + SNR lp + INRx) + SNR 2 + INR 2p + \h lx h 22 - h 12 h 21 \ 2 Q lp ^ ^ 

^ /< 1 + SNR 2 + INR 2 ^ B 

+ 1 + INR 2P J +Cl2 ' (369) 
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which is within 2 bits to the upper bound 

( SNRi INR 2 \h n h 22 - h 12 h 2l \ 2 \ 

* + 2 *» * lQg I 1 + iTn^ + ' NRl + + ITh^ + 1 + INR2 J (370) 

+ log(l + SNR 2 + INR 2 ) + Cf 2 . (371) 

Therefore, we see that the bounds in ^ 2 -*i-^2 satisfies: 

• R\ bound is within 1 bit to outer bounds; 

• R 2 bound is within 1 bit to outer bounds; 

• R\ + R 2 bound is within 3 bits to outer bounds; 

• R\ + 2R 2 bound is within 3 bits to outer bounds. 



D. Proof of Claim 5.12 



Proof: (Keep in mind that Ai = A 2 = 1) 

(1) i?i bound: We have four bounds. First, 

I yi \x 2 ) + (C* - = log (1 + SNRO + (C* - (372) 
which is within £1 = 1 bit to the upper bound log (1 + SNRi) + C 21 . Second, 

I(xi;y 2 |a; 2 ) + (Cf 2 -6) + (373) 
= log (1 + INR 2 ) + (Cf 2 - 6) + > log (1 + SNRx + INR 2 ) - 1. (374) 

Hence if this bound is active, it is within 1 bit to the upper bound log (1 + SNRi + INR 2 ). Finally, 

U -1^1 / ^ + 2SNR 1 + INR 2 ^ 

I {Xi;y 1 ,y2\x 2 ) = log I J (375) 

t( ~l N 1 ^ 2 + SNR 1 + 2INR 2 ^ 

I [ x ii 2/2) 2/1F2) = log I J, (376) 

which are both within 1 bit to the upper bound log (1 + SNRx + INR 2 ). 

(2) R 2 bound: By symmetry we have the same gap result as (1). 

(3) Ri + R 2 bound: We have four bounds. First, 

I {x u x 2 ; Vl ) + (C* - 6) + = log (1 + SNRx + INRx) + (C* - £0+, (377) 
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which is within 1 + ^ = 2 bits to the upper bound 

R 1 + R 2 < log (1 + SNRx + INRi) + log (\ + 

Second, 



1 + INR 



SNR 2 



) 



+ C 



B 

•21- 



I(x 2 ,x 1 ;y 2 ) + (C 



12 



6) 



+ 



log(l + SNR 2 + INR 2 ) + (C 



12 



6) 



which is within 1 + £ 2 = 2 bits to the upper bound 



Ri + R 2 < log (1 + SNR 2 + INR 2 ) + log (1 + 1 + mR 1 + C 





J (x 2 , xi; y 2 , y x ) = log I 

which are both within 1 bit to the upper bound 

Ri + R 2 < log (1 + SNRi + INRx + SNR 2 + INR 2 + \h u h 22 - h 12 h 21 \ 2 ) . 

Therefore, we see that the bounds in ^oneRound satisfies: 

• R\ bound is within 1 bit to outer bounds; 

• R 2 bound is within 1 bit to outer bounds; 

• R\ + R 2 bound is within 2 bits to outer bounds. 



Appendix D 



Proof of Theorem |6.2| 



From Section |V-El we have shown that when SNR < INR, 



R 




Hence we focus on the case SNR > INR in the rest of the proof. 
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By symmetry and by Theorem |5.10[ if -R sym ,o n eRound > satisfies the following, it is achiev- 
able: 

#sym,OncRound < mill {/ (x 2c , X X ] y X \x lc ) + (C^ - + , I {x 2c , XlJ Vl, % |^lc) } (385) 

-Rsym,oncRound < min { I (xr, yi|x 2c ) + (C^ - £1) + , / (xi ; yt , % \x 2c ) } (386) 

2-R sym ,OneRound < min { / (x x , x 2c ; Vi ) + (C 21 - £1) + , / (xi , x 2c ; y x , y 2 ) } (387) 

+ min{/ {x 1 ]yi\xx c , x 2c ) + (Cf x - , I (x^yt^^x^, x 2c )} (388) 

Note that since 

I (xi]yi\xi c ,x 2c ) < I (xi; yi,y 2 \x lc ,x 2c ) < I (xr, yi\x lc , x 2c ) + constant, (389) 

I {xi\yi\x 2c ) < I (x 1 ;y 1 ,y 2 \x 2c ) < I (xi, y x \x 2c ) + constant, (390) 

a sufficient condition for achievable -R sy m,OneRound is 

-Rsym.OneRound < mm {/ (x 2c , X\] yi\X\ c ) + (C^ - £l) + , / (x 2c , X X \ ?/l , % \X\ C ) } (391) 

-Rsym.OneRound < I \ x l\ yi\x 2c ) (392) 

-Rsym.OneRound < ^ mm { I (x h X 2c ] T/l) + (C 21 - + , I (x U X 2c ] y U %) } (393) 

+ ^I{x 1 \y 1 \x lc ,x 2c ) (394) 
(1) I (x 2c , xi, yi\x lc ) + (Cfi - £i) + : 

J (x 2c , x i; yi |x lc ) + (C* - 6) + = log ( 1+ 1 S ^ N R p ' NR ) + (C B - + (395) 
The gap to the outer bound log (l + INR + jgj^) + C B : 

gap < log (1 + INRp) + f < 1 + log 3. (396) 
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(2) I (x 2c ,x 1 ;y 1 ,y 2 \x lc ): 

I (x 2 c,x 1 ;y 1 ,y 2 \x lc ) = I (x 2c ; yi, V2\xic) + I (xi, yi, %\x 2c , x lc ) (397) 

> I (x 2c ;y 2 \x lc ) +i"(xi;yi|x 2c ,xi c ) (398) 

= / 1 + A + SNR + INR P X / l + SNRp + INR P \ 

g Vl + A + SNRp + INRj + g V 1 + INR P J 
( a ) , / 1 + SNR \ , (\ + SNR„\ 



/1 + SNR\ 

where (a) is due to A = max {1, SNR P }, SNR P > INR P , and hence 



(401) 



, 1 + 2SNR„ + INR„ < 2 + 2SNR p ifA = SNR„>l 

1 + A + SNR P + INR P = { v v- v v- (4Q2) 

2 + SNR p + INR P < 2 + 2SNR p ifA = l>SNR p 
Therefore, the gap to the outer bound log (1 + SNR + INR): 

gap < 1 + log ( 1+ 1 S ^s^ R ' NR ) + log (1 + INRp) (403) 

- 1 + log (itm) + log (1 + 1} = 3 - (404) 

(3) I {x x \y x \x 2c ): 

I (xi, y\\x 2c ) = log (1 + SNR + INRp) - log (1 + INR P ) . (405) 
The gap to the outer bound log (1 + SNR + INR): 

ga ^ log (rTs^^) +log ( 1 + INR ^ (406) 

- log (lTw) +log(1 + 1) = 2 - (407) 

(4) \I (xi^x^yi) + |(C^ + \I (xi,yi\x lc ,x 2c ): 

1 1 r. 1 

-J(xi,x 2c ;t/i) + -(C 21 2 7 { x uvA x ic,x 2c ) (408) 

= \ log (1 + SNR + INR) + ^(C 8 + \ log (1 + SNR P + INR p ) - log (1 + INR P ) (409) 
The gap to the outer bound \ log (1 + SNR + INR) + \ log (l + + ±C B : 

gap < ^ + log(l + INRp) < \ log 3 + 1. (410) 
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(5) ll(x 1 ,x 2c ;yi,y2) + \l {xi]yi\x lc ,x 2c )\ 

1 1 

-I (xi, x 2c \ yi, y 2 ) + 2 J fail Vi \ x ic, x 2c ) 

1 /A (1 + SNR + INR) + 1 + 2SNR + 2INR + \h u h 22 - h 12 h 21 \ 2 
~ 2 ° g V A (1 + INR P ) + 1 + SNR P + INR P 

1 (\ + SNR„ + INR P 
+ 2 l0g { 1 + INR P 

1 /l + 2SNR + 2INR+|/i 11 /i 22 -/i 12 /i 21 | 2 \ 1 / A 

- 2 log { sa ) + 2 log IrriNR; 

= - log (1 + 2SNR + 2INR + \h n h 22 - h 12 h 21 \ 2 ) - l - log (1 + INR P ) - ^ log 5 
Therefore, the gap to the outer bound | log (1 + 2SNR + 2INR + \h n h 22 — h X2 h 2 \ 

gap< llog(l + INR p ) + ^log5< 1 + * Qg5 . 
From (1) - (5), we conclude that when SNR > INR, 



2\. 



R 



sym,OneRound — Csym — Csym — -^sym,OneRound 



(411) 
(412) 

(413) 
(414) 
(415) 

(416) 

(417) 



This completes the proof. 



Appendix E 
Proof of Lemma I7T21 

Proof: From Corollary [7T we see that except the term 



V :=- log (1 + 2SNR + 2INR + \h n h 22 - h 12 h 21 \ 2 ) 



(418) 



all terms scaled by log SNR converges everywhere as SNR — > oo with a, k fixed. Note that 

\h u h 22 - h 12 h 21 \ 2 = Isue^W 022 - 9i2e^g 2 ie^\ 2 (419) 

1 2 

= 0u022 cos (Gn + 6 22 ) - ^12^21 cos (9i2 + 9 2 i) (420) 

1 2 

+ 0H022 sin (9u + 6 22 ) - #12321 sin (9 i2 + 2 i) (421) 

= 011022 + 012021 - 2011022012021 cos (6n + 6 22 - 9 i2 - 9 2 i) (422) 

= SNR 2 + INR 2 -2(cos6)SNRINR, (423) 
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where = n + 2 2 — ©12 — ©21 mod 2n. Obviously is uniformly distributed over [0, 2n}. 
Now, consider the limit 

L(<x,k):= lim - . (424) 

V ' ^ fix a,K logSNR V 
SNR->oo 

We have the following upper and lower bounds for V due to the fact that ||/in||/i22| — 

|^12| I ^-21 1 I 1^11^22 ~~ ^12^21 1 ^ |^ll||^22| + |^12||^2l| : 

V > \ log (1 + 2SNR + 2INR + (SNR - INR) 2 ) ; (425) 

V < - log (1 + 2SNR + 2INR + (SNR + INR) 2 ) . (426) 

Hence, when a < 1, taking limits at both sides yields 1 < L(a, k) < 1 and implies L(a, k) = 1. 
Similarly, when a > 1, taking limits at both sides yields a < L(a, k) < a and implies L(a, k) = 
a. When a — 1, note that 

V = - log (1 + 2SNR + 2INR + SNR 2 + INR 2 - 2(cos 0)SNRINR) (427) 
= ^log ^(1 + SNR + INR) 2 -4 cos 2 ®SNRINR^ , (428) 

and therefore L(a, k) = 1 if 7^ 0, 2ir. Since the event {0 = 0, 2ir} is of zero measure, the 
limit L{ol,k) exists almost surely. ■ 
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